-- Logs begin at Wed 2022-07-27 16:46:57 UTC, end at Wed 2022-07-27 18:17:42 UTC. -- Jul 27 17:50:59.948468 dv-osbrick-849019-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 17:50:59.958085 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 17:50:59.960122 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 17:50:59 2022] *** Jul 27 17:50:59.960122 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 17:50:59.960122 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 17:50:59.960122 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: nodename: dv-osbrick-849019-4-ceph Jul 27 17:50:59.960122 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: machine: x86_64 Jul 27 17:50:59.960122 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: clock source: unix Jul 27 17:50:59.960122 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: pcre jit disabled Jul 27 17:50:59.960122 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: detected number of CPU cores: 4 Jul 27 17:50:59.960122 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: current working directory: / Jul 27 17:50:59.960122 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: detected binary path: /usr/bin/uwsgi-core Jul 27 17:50:59.960783 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: your processes number limit is 47680 Jul 27 17:50:59.960783 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: your memory page size is 4096 bytes Jul 27 17:50:59.960783 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: detected max file descriptor number: 2048 Jul 27 17:50:59.960783 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: lock engine: pthread robust mutexes Jul 27 17:50:59.960783 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: thunder lock: enabled Jul 27 17:50:59.960783 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 17:50:59.960783 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 17:51:00.005455 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: Python main interpreter initialized at 0x5611afecc9c0 Jul 27 17:51:00.005455 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: python threads support enabled Jul 27 17:51:00.005455 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: your server socket listen backlog is limited to 100 connections Jul 27 17:51:00.005455 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: your mercy for graceful operations on workers is 90 seconds Jul 27 17:51:00.005818 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 17:51:00.005894 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: *** Operational MODE: preforking *** Jul 27 17:51:00.006131 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: *** uWSGI is running in multiple interpreter mode *** Jul 27 17:51:00.006131 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: spawned uWSGI master process (pid: 87209) Jul 27 17:51:00.006340 dv-osbrick-849019-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 27 17:51:00.007976 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: spawned uWSGI worker 1 (pid: 87220, cores: 1) Jul 27 17:51:00.007976 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: spawned uWSGI worker 2 (pid: 87221, cores: 1) Jul 27 17:51:00.007976 dv-osbrick-849019-4-ceph devstack@keystone.service[87209]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 17:51:05.795298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 17:51:05.795298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: from cryptography.utils import int_from_bytes Jul 27 17:51:05.795995 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 17:51:05.795995 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: from cryptography.utils import int_from_bytes Jul 27 17:51:05.802098 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 17:51:05.802098 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: from cryptography.utils import int_from_bytes Jul 27 17:51:05.802667 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 17:51:05.802667 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: from cryptography.utils import int_from_bytes Jul 27 17:51:05.846573 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 17:51:05.846773 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 17:51:05.846965 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] command line args: [] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 17:51:05.847244 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 17:51:05.847425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ================================================================================ {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 17:51:05.847682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] admin_token = **** {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.847928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] config_dir = [] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.848116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.848299 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] config_source = [] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.848480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] debug = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.848681 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.849059 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.849242 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.849500 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.849751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.849984 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] list_limit = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.850163 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] log_config_append = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.850341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.850536 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] log_dir = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.850717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] log_file = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.850870 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 17:51:05.850987 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.851115 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 17:51:05.851200 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.851277 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] command line args: [] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 17:51:05.851430 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.851516 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 17:51:05.851673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ================================================================================ {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 17:51:05.851795 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.851874 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.851999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] admin_token = **** {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.852076 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.852201 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] config_dir = [] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.852277 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.852400 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.852482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.852567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] config_source = [] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.852666 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] debug = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.852750 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.852882 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.852985 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.853118 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.853204 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.853281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.853404 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.853533 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.853618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.853779 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.853906 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.854008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] list_limit = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.854099 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.854179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] log_config_append = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.854348 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.854541 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] log_dir = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.854623 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.854752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] log_file = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.854829 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] publish_errors = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.854958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.855039 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.855173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.855252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.855370 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.855459 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.855623 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.855704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.855835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.855916 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.855988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.856082 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] standard_threads = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.856211 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.856313 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.856444 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.856556 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.856675 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.856753 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.856905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] use_journal = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.856988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.857066 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] use_json = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.857144 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.857245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] use_stderr = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.857345 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.857441 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] use_syslog = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.857595 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.857676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.857838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.857968 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.858110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.858196 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.858371 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.858630 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.858732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.858814 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] publish_errors = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.858886 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.859034 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.859120 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.859833 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.859948 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.860072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.860203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.860347 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.860484 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.860623 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.860703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.860776 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] standard_threads = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.860847 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.860956 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.861056 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.861163 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.861262 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.861358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.861464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] use_journal = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.861559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.861655 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] use_json = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.861760 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.861859 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] use_stderr = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.861964 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] use_syslog = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.862048 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.862151 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 17:51:05.862232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.862404 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.862483 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.862665 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.862756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.862930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.863014 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.863168 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.863417 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.863502 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.863652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.863807 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.863890 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.863962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.864119 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.864199 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.864364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.864451 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.864595 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.864673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.864828 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.864906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.865057 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.865145 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.865299 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.865378 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.865531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.865610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.865762 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.865846 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.865993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.866073 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.866224 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.866306 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.866473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.866613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.866738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.866817 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.866977 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.867051 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.867210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.867298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.867445 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.867522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.867681 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.867768 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.867911 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.868006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.868143 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.868222 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.868373 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.868452 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.868604 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.868691 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.868829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.868906 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.869060 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.869139 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.869294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.869446 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.869521 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.869592 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.869746 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.869825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.869971 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.870056 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.870206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.870283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.870447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.870544 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.870701 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.870790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.870937 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.871017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.871165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.871242 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.871399 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.871483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.871628 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.871711 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.871856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.871933 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.872083 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.872161 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.872310 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.872389 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.872537 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.872621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.872770 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.872858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.872999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.873085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.873229 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.873307 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.873461 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.873549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.873687 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.873772 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.873919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.873997 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.874151 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.874230 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.874394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.874473 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.874651 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.874739 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.874966 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.875580 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.875715 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.875854 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.875988 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.876125 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.876254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.876343 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.876425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.876499 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.876617 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.876730 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.876858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.876983 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.877095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.877219 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.877337 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.877456 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.877682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.877774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.877857 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.877948 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.878023 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.878160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.878248 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.878388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.878477 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.878655 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.878759 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.878901 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.879002 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.879169 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.879257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.879408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.879488 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.879658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.879738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.879903 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.879991 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.880139 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.880217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.880371 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.880452 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.880600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.880686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.880831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.880910 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.881061 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.881141 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.881292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.881445 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.881522 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.881598 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.881750 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.881830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.881983 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.882069 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.882214 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.882302 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.882446 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.882546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.882704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.882843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.882963 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.883117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.883197 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.883364 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.883450 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.883599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] auth.external = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.883687 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.883834 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.883915 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.884095 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.884179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.884327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.884415 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.884560 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.884646 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] auth.password = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.884787 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.884866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] auth.token = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.885015 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.885110 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.885242 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.885322 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.885475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.885555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.885702 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.885790 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.885940 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.886021 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.886173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.886262 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.886408 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.886486 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.886668 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] credential.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.886762 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.886921 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.887000 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.887171 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.887257 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.887408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.887495 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.887644 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] auth.external = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.887724 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.887871 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.887951 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.888107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.888278 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.888359 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.888515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.888596 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.888747 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] auth.password = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.888833 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.888978 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] auth.token = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.889059 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.889216 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.889339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.889451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.889586 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.889699 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.889850 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.889930 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.890095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.890176 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.890354 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.890450 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.890639 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] federation.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.890771 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.890923 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.891066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] credential.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.891209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.891293 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.891447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.891527 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.891695 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.891776 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.891933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.892004 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.892172 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.892252 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.892403 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.892481 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.892658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.892848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.892947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.893019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.893132 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.893226 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.893378 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.893459 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.893617 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.893698 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.893868 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.893949 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.894120 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.894202 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.894356 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.894437 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.894619 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.894714 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.894855 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] federation.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.894936 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.895148 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.895284 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.895364 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.895437 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.895586 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.895662 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.895780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.895862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.896280 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.896361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.896512 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.896592 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.896743 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.896821 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.897542 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.897644 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.897644 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.897792 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.897866 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.897939 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.898021 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.898154 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.898238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.898318 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.898394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.898479 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.898641 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.898718 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.898805 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.898940 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.899062 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.899140 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.899217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.899290 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.899370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.899445 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.899540 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.899686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.899787 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.899869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.900034 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.900117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.900263 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.900343 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.900492 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.900579 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.900720 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.900801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.900961 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.901041 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.901198 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.901285 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.901439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.901519 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.901684 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.901763 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.901916 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.902005 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.902154 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.902235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.902386 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.902472 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.902646 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.902744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.902876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.902963 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.903110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.903191 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.903337 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.903425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.903569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.903650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.903808 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.903888 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.904044 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.904137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.904273 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.904360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.904504 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.904584 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.904746 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.904833 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.904992 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.905071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.905223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.905302 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.905455 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.905542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.905691 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.905771 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.905915 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.905995 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.906193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.906314 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.906611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.906764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.906902 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.906986 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.907050 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.907136 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.907213 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.907286 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.907442 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.907528 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.907675 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.907764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.907923 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.908005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.908166 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.908244 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.908393 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.908479 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.908619 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.908700 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.908858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.908937 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.909101 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.909189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.909335 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.909421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.909577 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.909657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.909810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.909902 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.910040 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.910127 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.910271 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.910356 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.910567 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.910667 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.910773 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.910852 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.911009 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.911088 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.911246 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.911335 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.911482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.911562 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.911711 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.911790 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.911938 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.912028 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.912169 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.912250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.912401 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.912481 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.912634 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.912722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.912862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.912942 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.913104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.913183 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.913348 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.913437 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.913589 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.913670 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.913831 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.913910 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.914071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.914158 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.914297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.914375 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.914550 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.914631 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.914784 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.914865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] resource.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.915017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.915097 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.915249 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.915329 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.915481 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.915561 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.915721 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.915801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.915965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.916045 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.916197 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.916277 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.916440 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.916519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.916665 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.916743 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.916904 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.916984 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.917134 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.917214 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] role.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.917369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.917449 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] role.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.917597 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.917677 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.917848 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.917933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.918084 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.918163 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.918310 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.918387 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.918554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.918639 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.918794 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] resource.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.918875 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.919041 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.919123 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.919287 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.919471 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.919554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.919628 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.919750 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.919833 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.919994 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.920079 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.920226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.920306 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.920469 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.920551 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.920701 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.920781 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.920935 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.921110 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.921200 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] role.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.921354 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.921434 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] role.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.921608 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.922187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.922400 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.922571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.922700 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.922897 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.923034 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.923118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.923192 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.923281 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.923363 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.923437 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.923595 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.923677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.923841 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.923923 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.924068 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.924148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.924299 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.924378 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.924530 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.924610 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.924772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.924851 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.925016 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.925097 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.925258 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.925341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.925494 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.925658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.925738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.925895 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.925984 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.926143 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.926224 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] token.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.926390 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.926471 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.926661 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.926756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.926897 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.926977 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.927128 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.927245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.927379 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.927468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.927622 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.927701 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.927863 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.927942 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.928092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.928181 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.928321 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.928402 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.928549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.928630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.928787 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.928874 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.929022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.929103 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.929268 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.929346 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.929502 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.929591 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.929730 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.929809 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.929955 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.930034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.930187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] token.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.930276 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.930419 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.930500 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.connection = **** {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.930690 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.930780 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.930922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.931002 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.931174 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.931256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.931418 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.931498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.931650 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.931730 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.931885 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.931965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.932121 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.932202 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.932360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.932440 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.932590 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.932669 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.932825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.932905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.933055 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.933136 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.933288 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.933372 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.933530 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.933609 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.933756 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.933836 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.933994 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.934076 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.934223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.934301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.934462 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.934597 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.connection = **** {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.934720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.934816 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.934892 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 17:51:05.935025 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.935261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.935498 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.935730 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.935963 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.936196 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.936429 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.936670 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.936912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.937151 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.938052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.938315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.938646 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.938886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.939116 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.939354 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.939587 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 17:51:05.939755 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 17:51:05.965576 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:05.965804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:05.966029 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:05.968090 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:05.968323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:05.968547 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:05.975444 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:05.979165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.006051 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.006319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.007878 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.008111 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.059574 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.059813 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.110834 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.111124 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.111322 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.111562 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.176675 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.176940 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.177113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.177335 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.177469 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.177604 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.177734 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.177873 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.178017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.178017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.178273 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.178407 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.201732 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.201985 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.202169 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.202307 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.202442 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.202621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.202774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.202910 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.203109 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.203754 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.203754 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.204123 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.204326 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.204326 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.215061 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.215574 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.227805 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.228034 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.228251 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.228440 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.228572 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.228715 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.228843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.228973 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.229101 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.229227 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.229363 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.229363 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.229625 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.229710 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 17:51:06.245895 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.246089 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 17:51:06.246432 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.246637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.246778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 17:51:06.246911 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 17:51:06.247042 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.247184 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.247320 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.247461 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 17:51:06.247595 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.247725 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.247854 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.247991 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.248119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.248341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.257984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.258256 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.258529 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.258748 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.258892 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.259023 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.259286 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.259574 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.268193 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.269064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.271430 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.271702 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.271979 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.272255 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.272343 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.272532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.272618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.272791 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.272937 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.273070 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.273201 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.273333 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.273463 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.273601 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.273752 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.273838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.273904 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.274072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.274157 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.274413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.274711 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.274981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.297250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.298624 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.298933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.299210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.300139 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.300421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.303862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.304137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.304420 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.305117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.305400 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.305685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.311316 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.311427 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.312971 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.313250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.316241 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.316520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.316812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.317109 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.317389 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.317472 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.317675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.317768 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.317967 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.318052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.318256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.318341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.318565 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.318964 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.319241 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.319520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.334736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.335011 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.336338 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.336619 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.338913 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.340613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.342074 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.342368 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.344479 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.344813 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.347361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.349406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.350534 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.352631 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.353711 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.354012 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.354297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.354601 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.354876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.355261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.355837 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.356135 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.356428 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.356709 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.357038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.357376 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.371356 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.371638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.371905 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.372165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.373608 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.373893 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.374160 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.374433 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.379749 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.381430 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.381712 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.382011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.383721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.384016 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.384429 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.384706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.384983 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.385275 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.385559 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.386853 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.387136 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.387423 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.387706 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.387983 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.397382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.397657 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.397936 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.398214 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.398492 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.398799 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.399085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.399856 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.400137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.400418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.400702 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.400982 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.401257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.401536 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.414779 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.417427 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.417898 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.420454 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.422371 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.423868 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.425030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.425364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.425639 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.425931 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.426520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.428064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.428338 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.428619 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.538044 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.539596 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.541227 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.542490 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.542788 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.542878 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.543072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.543354 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.545702 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.545991 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.546273 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.546574 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.551959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.552240 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.552516 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.555243 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.555529 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.555810 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.559394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.559777 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.560069 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.560346 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.560623 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.560910 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.561182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.561500 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.561727 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.561999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.562277 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.563312 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.563478 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 17:51:06.563657 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.563865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.563969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.564278 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.564707 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.565127 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.565420 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.565699 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.565975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.566256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.566548 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.566824 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.567094 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.567361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.567623 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 17:51:06.597287 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611afecc9c0 pid: 87220 (default app) Jul 27 17:51:06.600905 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520240c-f289-4f7c-bf23-919aa980ac64 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:06.601191 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520240c-f289-4f7c-bf23-919aa980ac64 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:06.601467 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520240c-f289-4f7c-bf23-919aa980ac64 None None] PATH_INFO: `/v3` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:06.601621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611afecc9c0 pid: 87221 (default app) Jul 27 17:51:06.605629 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 791 bytes} [Wed Jul 27 17:51:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:14.932947 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dedb1-a458-4b9a-b3d8-3b1007467d4d None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:14.933503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dedb1-a458-4b9a-b3d8-3b1007467d4d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:14.933503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dedb1-a458-4b9a-b3d8-3b1007467d4d None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:14.938535 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:14.944049 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572314a-88a8-420e-b3ed-34bec81da8d2 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:14.944513 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572314a-88a8-420e-b3ed-34bec81da8d2 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:14.944607 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572314a-88a8-420e-b3ed-34bec81da8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:15.023341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: INFO dbcounter [None req-4572314a-88a8-420e-b3ed-34bec81da8d2 None None] Registered counter for database keystone Jul 27 17:51:15.045294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG oslo_db.sqlalchemy.engines [None req-4572314a-88a8-420e-b3ed-34bec81da8d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 17:51:15.052006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writer thread running {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 17:51:15.233932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG passlib.handlers.bcrypt [None req-4572314a-88a8-420e-b3ed-34bec81da8d2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87220) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 17:51:15.234408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG passlib.handlers.bcrypt [None req-4572314a-88a8-420e-b3ed-34bec81da8d2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87220) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 17:51:15.289990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-4572314a-88a8-420e-b3ed-34bec81da8d2 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:15.291673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-4572314a-88a8-420e-b3ed-34bec81da8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:15.416652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 2/3] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 27 17:51:15.557294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dedb1-a458-4b9a-b3d8-3b1007467d4d None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:15.633002 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: INFO dbcounter [None req-ca6dedb1-a458-4b9a-b3d8-3b1007467d4d None None] Registered counter for database keystone Jul 27 17:51:15.652421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG oslo_db.sqlalchemy.engines [None req-ca6dedb1-a458-4b9a-b3d8-3b1007467d4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 17:51:15.658590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writer thread running {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 17:51:15.779884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dedb1-a458-4b9a-b3d8-3b1007467d4d None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:15.784709 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630a9a1-9568-4894-9384-860cbf87f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:15.785354 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630a9a1-9568-4894-9384-860cbf87f492 admin admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:15.785633 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630a9a1-9568-4894-9384-860cbf87f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:15.785905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630a9a1-9568-4894-9384-860cbf87f492 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:15.794826 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630a9a1-9568-4894-9384-860cbf87f492 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:15.847049 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0630a9a1-9568-4894-9384-860cbf87f492 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 17:51:15.847382 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630a9a1-9568-4894-9384-860cbf87f492 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:15.857267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1324 bytes} [Wed Jul 27 17:51:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 17:51:15.864166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572314a-88a8-420e-b3ed-34bec81da8d2 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:15.878922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572314a-88a8-420e-b3ed-34bec81da8d2 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:15.883437 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ddcaa-6d1b-4766-890c-b55b668d9c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:15.884545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ddcaa-6d1b-4766-890c-b55b668d9c45 admin admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:15.884835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ddcaa-6d1b-4766-890c-b55b668d9c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:15.885123 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ddcaa-6d1b-4766-890c-b55b668d9c45 admin admin] PATH_INFO: `/v3/projects/62c6a98aca8a4b2da0a78051d92a86b2` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:15.886680 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ddcaa-6d1b-4766-890c-b55b668d9c45 admin admin] RBAC: Authorizing `identity:get_project(project_id=62c6a98aca8a4b2da0a78051d92a86b2)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:15.938575 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b87ddcaa-6d1b-4766-890c-b55b668d9c45 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 17:51:15.938918 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ddcaa-6d1b-4766-890c-b55b668d9c45 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:15.943676 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 3/5] 10.222.0.73 () {56 vars in 1207 bytes} [Wed Jul 27 17:51:15 2022] GET /identity/v3/projects/62c6a98aca8a4b2da0a78051d92a86b2 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:18.240044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994651a6-1736-4885-b1c4-b9f1d7091f1a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:18.240600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994651a6-1736-4885-b1c4-b9f1d7091f1a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:18.240600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994651a6-1736-4885-b1c4-b9f1d7091f1a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:18.244945 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 3/6] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:18.251040 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c802d8d-2fa2-494d-b643-5ebce48d975a None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:18.251481 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c802d8d-2fa2-494d-b643-5ebce48d975a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:18.251583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c802d8d-2fa2-494d-b643-5ebce48d975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:18.273178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-8c802d8d-2fa2-494d-b643-5ebce48d975a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:18.274729 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-8c802d8d-2fa2-494d-b643-5ebce48d975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:18.282736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 17:51:18.306148 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994651a6-1736-4885-b1c4-b9f1d7091f1a None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:18.319222 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994651a6-1736-4885-b1c4-b9f1d7091f1a None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:18.323474 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349995d-eb97-40b3-8bc5-cda3452d88b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:18.324084 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349995d-eb97-40b3-8bc5-cda3452d88b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:18.324371 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349995d-eb97-40b3-8bc5-cda3452d88b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:18.324656 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349995d-eb97-40b3-8bc5-cda3452d88b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:18.333176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349995d-eb97-40b3-8bc5-cda3452d88b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:18.334995 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349995d-eb97-40b3-8bc5-cda3452d88b4 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:18.343839 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1324 bytes} [Wed Jul 27 17:51:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 17:51:18.349728 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c802d8d-2fa2-494d-b643-5ebce48d975a None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:18.358947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c802d8d-2fa2-494d-b643-5ebce48d975a None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:18.363502 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218f96f-b07d-4fb9-a53c-d4ca7c548499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:18.364146 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f96f-b07d-4fb9-a53c-d4ca7c548499 admin admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:18.364428 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f96f-b07d-4fb9-a53c-d4ca7c548499 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:18.364709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f96f-b07d-4fb9-a53c-d4ca7c548499 admin admin] PATH_INFO: `/v3/users/1c437a71edd54d15a20aca35e290b469` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:18.366089 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218f96f-b07d-4fb9-a53c-d4ca7c548499 admin admin] RBAC: Authorizing `identity:get_user(user_id=1c437a71edd54d15a20aca35e290b469)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:18.367941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218f96f-b07d-4fb9-a53c-d4ca7c548499 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:18.369501 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 5/9] 10.222.0.73 () {56 vars in 1198 bytes} [Wed Jul 27 17:51:18 2022] GET /identity/v3/users/1c437a71edd54d15a20aca35e290b469 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:20.659535 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ab17f-96ee-4f8b-83bd-357bce3836ff None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:20.660084 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ab17f-96ee-4f8b-83bd-357bce3836ff None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:20.660084 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ab17f-96ee-4f8b-83bd-357bce3836ff None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:20.661434 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:20.666648 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8913be-f9c8-411c-b9fd-d47433afb5f3 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:20.667039 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8913be-f9c8-411c-b9fd-d47433afb5f3 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:20.667321 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8913be-f9c8-411c-b9fd-d47433afb5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:20.687207 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-4c8913be-f9c8-411c-b9fd-d47433afb5f3 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:20.689359 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-4c8913be-f9c8-411c-b9fd-d47433afb5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:20.691383 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f93b74-3fdd-4e3e-b4c7-0a3147e64a39 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:20.691675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f93b74-3fdd-4e3e-b4c7-0a3147e64a39 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:20.691956 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f93b74-3fdd-4e3e-b4c7-0a3147e64a39 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:20.693295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 6/11] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:51:20.698431 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db849b-9360-481a-8b7c-ee74ef4f8380 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:20.698741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db849b-9360-481a-8b7c-ee74ef4f8380 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:20.699024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db849b-9360-481a-8b7c-ee74ef4f8380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:20.741091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG passlib.handlers.bcrypt [None req-28db849b-9360-481a-8b7c-ee74ef4f8380 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87221) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 17:51:20.741513 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG passlib.handlers.bcrypt [None req-28db849b-9360-481a-8b7c-ee74ef4f8380 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87221) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 17:51:20.772907 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 6/12] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:20.788472 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-28db849b-9360-481a-8b7c-ee74ef4f8380 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:20.790099 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-28db849b-9360-481a-8b7c-ee74ef4f8380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:20.797746 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8913be-f9c8-411c-b9fd-d47433afb5f3 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:20.823441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:20.896438 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:51:20.913628 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8913be-f9c8-411c-b9fd-d47433afb5f3 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:20.920766 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db849b-9360-481a-8b7c-ee74ef4f8380 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:20.948400 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afb9fd-a25e-4f10-8979-a57bd2d47501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:20.949061 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afb9fd-a25e-4f10-8979-a57bd2d47501 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:20.949347 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afb9fd-a25e-4f10-8979-a57bd2d47501 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:20.949644 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afb9fd-a25e-4f10-8979-a57bd2d47501 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:20.961468 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afb9fd-a25e-4f10-8979-a57bd2d47501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-d7afb9fd-a25e-4f10-8979-a57bd2d47501 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:20.971237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:20.972228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:20.973182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 7/14] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:51:20.978261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afb9fd-a25e-4f10-8979-a57bd2d47501 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:21.023091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db849b-9360-481a-8b7c-ee74ef4f8380 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:21.025361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:21.061719 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e8cee-997b-4dcb-b507-f836aad04abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:21.063225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:21.063379 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e8cee-997b-4dcb-b507-f836aad04abd None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:21.064372 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e8cee-997b-4dcb-b507-f836aad04abd None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:21.064660 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e8cee-997b-4dcb-b507-f836aad04abd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:21.082752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afb9fd-a25e-4f10-8979-a57bd2d47501 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:21.116196 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e2fc0-ca9b-48b9-9a02-166227bc17c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:21.116816 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2fc0-ca9b-48b9-9a02-166227bc17c7 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:21.117091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2fc0-ca9b-48b9-9a02-166227bc17c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:21.117370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2fc0-ca9b-48b9-9a02-166227bc17c7 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:21.118082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e2fc0-ca9b-48b9-9a02-166227bc17c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:21.118383 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e2fc0-ca9b-48b9-9a02-166227bc17c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:21.119829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e2fc0-ca9b-48b9-9a02-166227bc17c7 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:21.131929 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 8/15] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:21.132175 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e8cee-997b-4dcb-b507-f836aad04abd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:21.133786 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e8cee-997b-4dcb-b507-f836aad04abd None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:21.137429 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e2fc0-ca9b-48b9-9a02-166227bc17c7 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:21.231250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 8/16] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 17:51:21.237489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e8cee-997b-4dcb-b507-f836aad04abd None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:21.239188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e2fc0-ca9b-48b9-9a02-166227bc17c7 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:21.240352 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:21.278191 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4daf00-cc0d-4ecd-94fe-2dba5d558ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:21.278878 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4daf00-cc0d-4ecd-94fe-2dba5d558ca9 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:21.279488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4daf00-cc0d-4ecd-94fe-2dba5d558ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:21.279777 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4daf00-cc0d-4ecd-94fe-2dba5d558ca9 None admin] PATH_INFO: `/v3/users/1c437a71edd54d15a20aca35e290b469` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:21.281152 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4daf00-cc0d-4ecd-94fe-2dba5d558ca9 None admin] RBAC: Authorizing `identity:get_user(user_id=1c437a71edd54d15a20aca35e290b469)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:21.283316 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4daf00-cc0d-4ecd-94fe-2dba5d558ca9 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:21.284915 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 9/17] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:21 2022] GET /identity/v3/users/1c437a71edd54d15a20aca35e290b469 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:21.290247 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4daf00-cc0d-4ecd-94fe-2dba5d558ca9 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:21.305353 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:21.335995 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e8cee-997b-4dcb-b507-f836aad04abd None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:21.369930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beeb5c-540f-44e3-b7f7-0ddd88db5c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:21.370820 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beeb5c-540f-44e3-b7f7-0ddd88db5c1e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:21.371104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beeb5c-540f-44e3-b7f7-0ddd88db5c1e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:21.371381 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beeb5c-540f-44e3-b7f7-0ddd88db5c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:21.390041 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4daf00-cc0d-4ecd-94fe-2dba5d558ca9 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:21.391891 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beeb5c-540f-44e3-b7f7-0ddd88db5c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:21.393384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beeb5c-540f-44e3-b7f7-0ddd88db5c1e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-64beeb5c-540f-44e3-b7f7-0ddd88db5c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:51:21.411627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:21.412676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:21.413696 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:51:21.413696 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:51:21.413696 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:51:21.413696 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:21.413696 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 9/18] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:51:21.420548 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beeb5c-540f-44e3-b7f7-0ddd88db5c1e None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:21.426981 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942cf32-317e-41a4-b00a-6713f09cb31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:21.427637 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942cf32-317e-41a4-b00a-6713f09cb31f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:21.427924 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942cf32-317e-41a4-b00a-6713f09cb31f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:21.428206 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942cf32-317e-41a4-b00a-6713f09cb31f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:21.429404 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942cf32-317e-41a4-b00a-6713f09cb31f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:21.430922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942cf32-317e-41a4-b00a-6713f09cb31f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:21.432500 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 10/19] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:21.438745 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942cf32-317e-41a4-b00a-6713f09cb31f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:21.477818 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:21.520045 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:21.521522 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beeb5c-540f-44e3-b7f7-0ddd88db5c1e None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:21.540209 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942cf32-317e-41a4-b00a-6713f09cb31f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:21.555348 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3da15-af10-4b82-9be6-d493dbdb7e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:21.555967 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3da15-af10-4b82-9be6-d493dbdb7e14 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:21.556250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3da15-af10-4b82-9be6-d493dbdb7e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:21.556523 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3da15-af10-4b82-9be6-d493dbdb7e14 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:21.557221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3da15-af10-4b82-9be6-d493dbdb7e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:21.557528 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3da15-af10-4b82-9be6-d493dbdb7e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:21.559799 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3da15-af10-4b82-9be6-d493dbdb7e14 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:21.574400 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc0254-7afa-4ae6-9af4-b6c56a192e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:21.575084 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc0254-7afa-4ae6-9af4-b6c56a192e06 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:21.575366 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc0254-7afa-4ae6-9af4-b6c56a192e06 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:21.575644 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc0254-7afa-4ae6-9af4-b6c56a192e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:21.576436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc0254-7afa-4ae6-9af4-b6c56a192e06 None admin] RBAC: Adding query filter params (role.id=d6d0c56d1054455c813546a2c761a7d0, scope.domain.id=default, user.id=1c437a71edd54d15a20aca35e290b469) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:21.576749 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc0254-7afa-4ae6-9af4-b6c56a192e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:21.577410 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 10/20] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:21.578794 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc0254-7afa-4ae6-9af4-b6c56a192e06 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:21.586417 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 11/21] 10.222.0.73 () {56 vars in 1322 bytes} [Wed Jul 27 17:51:21 2022] GET /identity/v3/role_assignments?user.id=1c437a71edd54d15a20aca35e290b469&scope.domain.id=default&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:24.120945 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec03e1-c43b-4561-8a7d-ad78b365437d None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:24.121478 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec03e1-c43b-4561-8a7d-ad78b365437d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:24.121478 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec03e1-c43b-4561-8a7d-ad78b365437d None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:24.122894 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 11/22] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:24.128982 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0947-fe58-43c1-bbb4-b1f4b4c2062f None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:24.129445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0947-fe58-43c1-bbb4-b1f4b4c2062f None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:24.129632 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0947-fe58-43c1-bbb4-b1f4b4c2062f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:24.155501 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-82bd0947-fe58-43c1-bbb4-b1f4b4c2062f None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:24.157485 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-82bd0947-fe58-43c1-bbb4-b1f4b4c2062f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:24.247152 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 12/23] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:24.288080 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec03e1-c43b-4561-8a7d-ad78b365437d None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:24.428560 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec03e1-c43b-4561-8a7d-ad78b365437d None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:24.454369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:24.478935 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240434a4-3c45-4488-b627-5aa054e421a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:24.479591 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240434a4-3c45-4488-b627-5aa054e421a5 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:24.479878 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240434a4-3c45-4488-b627-5aa054e421a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:24.480162 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240434a4-3c45-4488-b627-5aa054e421a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:24.496106 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240434a4-3c45-4488-b627-5aa054e421a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-240434a4-3c45-4488-b627-5aa054e421a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:24.502862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:24.503721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:24.504486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 12/24] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:51:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:24.510240 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd0947-fe58-43c1-bbb4-b1f4b4c2062f None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:24.612537 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:24.642094 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd0947-fe58-43c1-bbb4-b1f4b4c2062f None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:24.663143 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce8e79-ca2f-4f0b-9122-d701ca577a45 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:24.663548 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce8e79-ca2f-4f0b-9122-d701ca577a45 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:24.663840 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce8e79-ca2f-4f0b-9122-d701ca577a45 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:24.665193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 13/25] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:51:24.676493 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227161be-41f9-4797-b2f2-ee41d4b5806a None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:24.676793 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227161be-41f9-4797-b2f2-ee41d4b5806a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:24.677082 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227161be-41f9-4797-b2f2-ee41d4b5806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:24.686696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c75ae-3e2e-4431-ac81-262b80164920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:24.687271 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c75ae-3e2e-4431-ac81-262b80164920 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:24.687555 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c75ae-3e2e-4431-ac81-262b80164920 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:24.687927 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c75ae-3e2e-4431-ac81-262b80164920 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:24.688773 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c75ae-3e2e-4431-ac81-262b80164920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:24.689090 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c75ae-3e2e-4431-ac81-262b80164920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:24.690492 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c75ae-3e2e-4431-ac81-262b80164920 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:24.710928 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 13/26] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:24.711913 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c75ae-3e2e-4431-ac81-262b80164920 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:24.719829 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-227161be-41f9-4797-b2f2-ee41d4b5806a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:24.721063 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-227161be-41f9-4797-b2f2-ee41d4b5806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:24.883724 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c75ae-3e2e-4431-ac81-262b80164920 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:24.890277 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 14/27] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:51:24.892426 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32864c5d-f734-448d-9bbd-462dcd1ac75a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:24.892940 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32864c5d-f734-448d-9bbd-462dcd1ac75a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:24.893441 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32864c5d-f734-448d-9bbd-462dcd1ac75a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:24.895352 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 15/28] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:24.901533 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922adfe-bfd2-48ae-a429-9c0ec0b10a57 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:24.901533 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922adfe-bfd2-48ae-a429-9c0ec0b10a57 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:24.901533 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922adfe-bfd2-48ae-a429-9c0ec0b10a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:24.940075 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-c922adfe-bfd2-48ae-a429-9c0ec0b10a57 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:24.941716 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-c922adfe-bfd2-48ae-a429-9c0ec0b10a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:24.971443 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2c647-3932-4427-aca0-3367abd43fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:24.972483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2c647-3932-4427-aca0-3367abd43fd2 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:24.972977 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2c647-3932-4427-aca0-3367abd43fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:24.973456 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2c647-3932-4427-aca0-3367abd43fd2 None admin] PATH_INFO: `/v3/users/1c437a71edd54d15a20aca35e290b469` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:24.976088 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2c647-3932-4427-aca0-3367abd43fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=1c437a71edd54d15a20aca35e290b469)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:24.977789 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2c647-3932-4427-aca0-3367abd43fd2 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:24.980626 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 14/29] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:24 2022] GET /identity/v3/users/1c437a71edd54d15a20aca35e290b469 => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:24.983456 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2c647-3932-4427-aca0-3367abd43fd2 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:25.002906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:25.070128 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 16/30] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:25.071468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922adfe-bfd2-48ae-a429-9c0ec0b10a57 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:25.107546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:25.115666 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2c647-3932-4427-aca0-3367abd43fd2 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:25.153140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2586b-52fd-46ca-bff4-02493890edd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:25.153817 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2586b-52fd-46ca-bff4-02493890edd8 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:25.154307 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2586b-52fd-46ca-bff4-02493890edd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:25.154821 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2586b-52fd-46ca-bff4-02493890edd8 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:25.155756 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2586b-52fd-46ca-bff4-02493890edd8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:25.157541 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2586b-52fd-46ca-bff4-02493890edd8 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:25.180998 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922adfe-bfd2-48ae-a429-9c0ec0b10a57 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:25.223807 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce180f-3905-4d68-b37c-cd8615350f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:25.224763 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce180f-3905-4d68-b37c-cd8615350f3d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:25.225225 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce180f-3905-4d68-b37c-cd8615350f3d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:25.225790 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce180f-3905-4d68-b37c-cd8615350f3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:25.227381 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce180f-3905-4d68-b37c-cd8615350f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:25.229069 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce180f-3905-4d68-b37c-cd8615350f3d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:25.231352 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 17/31] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:25.232698 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a9457-2b63-418b-9d70-7edee9b1114c None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:25.233157 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a9457-2b63-418b-9d70-7edee9b1114c None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:25.233667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a9457-2b63-418b-9d70-7edee9b1114c None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:25.235768 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 18/32] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:25.236745 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a9457-2b63-418b-9d70-7edee9b1114c None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:25.304374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 15/33] 10.222.0.73 () {60 vars in 1131 bytes} [Wed Jul 27 17:51:24 2022] POST /identity/v3/roles => generated 219 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:25.306178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eac48-d002-4806-b616-c78edff4e178 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:25.306568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eac48-d002-4806-b616-c78edff4e178 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:25.307031 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eac48-d002-4806-b616-c78edff4e178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:25.339040 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-f83eac48-d002-4806-b616-c78edff4e178 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:25.340850 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-f83eac48-d002-4806-b616-c78edff4e178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:25.376842 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a9457-2b63-418b-9d70-7edee9b1114c None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:25.383874 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:25.445550 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679abe8c-234f-4706-bf09-9142cb345471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:25.446202 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679abe8c-234f-4706-bf09-9142cb345471 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:25.446482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679abe8c-234f-4706-bf09-9142cb345471 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:25.446791 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679abe8c-234f-4706-bf09-9142cb345471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:25.463663 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:25.470633 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679abe8c-234f-4706-bf09-9142cb345471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:25.472160 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679abe8c-234f-4706-bf09-9142cb345471 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:25.480294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 16/34] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:25.481086 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eac48-d002-4806-b616-c78edff4e178 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-679abe8c-234f-4706-bf09-9142cb345471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:51:25.497620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:25.498499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:25.499391 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:51:25.499391 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:51:25.499391 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:51:25.499391 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:25.499391 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 19/35] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:25.500684 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e12a3f-3e45-43d3-bb4d-72104bd6cb87 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:25.501155 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e12a3f-3e45-43d3-bb4d-72104bd6cb87 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:25.501579 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e12a3f-3e45-43d3-bb4d-72104bd6cb87 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:25.508193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 20/36] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:25.508889 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e12a3f-3e45-43d3-bb4d-72104bd6cb87 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:25.639299 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eac48-d002-4806-b616-c78edff4e178 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:25.650873 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e12a3f-3e45-43d3-bb4d-72104bd6cb87 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:25.678526 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58e60-bedf-49a0-9c4f-e0e8d08acc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:25.679352 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58e60-bedf-49a0-9c4f-e0e8d08acc1a None admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:25.679730 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58e60-bedf-49a0-9c4f-e0e8d08acc1a None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:25.680328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58e60-bedf-49a0-9c4f-e0e8d08acc1a None admin] PATH_INFO: `/v3/domains/default/users/1c437a71edd54d15a20aca35e290b469/roles/d6d0c56d1054455c813546a2c761a7d0` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:25.684154 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a58e60-bedf-49a0-9c4f-e0e8d08acc1a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1c437a71edd54d15a20aca35e290b469, role_id=d6d0c56d1054455c813546a2c761a7d0)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:25.686721 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a58e60-bedf-49a0-9c4f-e0e8d08acc1a None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:25.686917 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a04b8-25bd-4b22-8f5d-48a999a1c588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:25.687543 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a04b8-25bd-4b22-8f5d-48a999a1c588 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:25.687888 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a04b8-25bd-4b22-8f5d-48a999a1c588 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:25.688368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a04b8-25bd-4b22-8f5d-48a999a1c588 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:25.689072 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a04b8-25bd-4b22-8f5d-48a999a1c588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:25.689378 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a04b8-25bd-4b22-8f5d-48a999a1c588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:25.690818 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a04b8-25bd-4b22-8f5d-48a999a1c588 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:25.709055 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 21/37] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:25.709248 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 17/38] 10.222.0.73 () {58 vars in 1361 bytes} [Wed Jul 27 17:51:25 2022] PUT /identity/v3/domains/default/users/1c437a71edd54d15a20aca35e290b469/roles/d6d0c56d1054455c813546a2c761a7d0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:51:25.709248 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58e60-bedf-49a0-9c4f-e0e8d08acc1a None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:25.711184 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aa846-ec1f-4916-857f-c6e35e430971 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:25.711677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aa846-ec1f-4916-857f-c6e35e430971 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:25.712124 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aa846-ec1f-4916-857f-c6e35e430971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:25.732514 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-fa6aa846-ec1f-4916-857f-c6e35e430971 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:25.733984 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-fa6aa846-ec1f-4916-857f-c6e35e430971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:25.747905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:25.802941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:25.815441 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 22/39] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:25.823251 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6aa846-ec1f-4916-857f-c6e35e430971 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:25.846988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58e60-bedf-49a0-9c4f-e0e8d08acc1a None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:25.891829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd32b29-0fc4-4094-a61b-97b1e03b329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:25.892769 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd32b29-0fc4-4094-a61b-97b1e03b329f None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:25.893162 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd32b29-0fc4-4094-a61b-97b1e03b329f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:25.893507 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd32b29-0fc4-4094-a61b-97b1e03b329f None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:25.894361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd32b29-0fc4-4094-a61b-97b1e03b329f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:25.896408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd32b29-0fc4-4094-a61b-97b1e03b329f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:25.919042 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 18/40] 10.222.0.73 () {60 vars in 1131 bytes} [Wed Jul 27 17:51:25 2022] POST /identity/v3/roles => generated 225 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:25.919866 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd32b29-0fc4-4094-a61b-97b1e03b329f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:25.977835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6aa846-ec1f-4916-857f-c6e35e430971 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:26.023310 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef860d4-b1dd-429f-b165-c5f3db95d10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:26.024344 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef860d4-b1dd-429f-b165-c5f3db95d10c None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:26.024855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef860d4-b1dd-429f-b165-c5f3db95d10c None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:26.025341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef860d4-b1dd-429f-b165-c5f3db95d10c None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:26.026280 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef860d4-b1dd-429f-b165-c5f3db95d10c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:26.028071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef860d4-b1dd-429f-b165-c5f3db95d10c None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:26.054251 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd32b29-0fc4-4094-a61b-97b1e03b329f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:26.067023 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:26.072023 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:26.106401 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5003ea-d067-46f5-9e3d-21443dbc718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:26.107081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5003ea-d067-46f5-9e3d-21443dbc718d None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:26.107365 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5003ea-d067-46f5-9e3d-21443dbc718d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:26.107639 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5003ea-d067-46f5-9e3d-21443dbc718d None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:26.108440 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5003ea-d067-46f5-9e3d-21443dbc718d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:26.109901 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5003ea-d067-46f5-9e3d-21443dbc718d None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:26.144566 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 19/41] 10.222.0.73 () {60 vars in 1131 bytes} [Wed Jul 27 17:51:25 2022] POST /identity/v3/roles => generated 223 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:26.184475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f900c-7a0c-4563-b8a4-7b3425e3b16d None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:26.185145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f900c-7a0c-4563-b8a4-7b3425e3b16d None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:26.185145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f900c-7a0c-4563-b8a4-7b3425e3b16d None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:26.186655 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 20/42] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:51:26.192382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3def6-66dd-4870-9cfb-6e0d236c8109 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:26.192680 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3def6-66dd-4870-9cfb-6e0d236c8109 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:26.192971 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3def6-66dd-4870-9cfb-6e0d236c8109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:26.216151 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-2aa3def6-66dd-4870-9cfb-6e0d236c8109 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:26.217443 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-2aa3def6-66dd-4870-9cfb-6e0d236c8109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:26.220935 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 23/43] 10.222.0.73 () {60 vars in 1141 bytes} [Wed Jul 27 17:51:25 2022] POST /identity/v3/projects => generated 301 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:26.307532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 21/44] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:51:26.334494 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef860d4-b1dd-429f-b165-c5f3db95d10c None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:26.457701 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef860d4-b1dd-429f-b165-c5f3db95d10c None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:26.497501 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1227b4-4d71-4ccd-aba8-66724aad9164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:26.498193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1227b4-4d71-4ccd-aba8-66724aad9164 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:26.498461 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1227b4-4d71-4ccd-aba8-66724aad9164 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:26.498777 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1227b4-4d71-4ccd-aba8-66724aad9164 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:26.500028 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1227b4-4d71-4ccd-aba8-66724aad9164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:26.502433 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1227b4-4d71-4ccd-aba8-66724aad9164 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:26.504102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 24/45] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:26.509814 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3def6-66dd-4870-9cfb-6e0d236c8109 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:26.612420 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3def6-66dd-4870-9cfb-6e0d236c8109 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:26.614791 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:26.649468 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cc294-42ba-4b99-93b6-4bef20f87d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:26.650100 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cc294-42ba-4b99-93b6-4bef20f87d8c None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:26.650388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cc294-42ba-4b99-93b6-4bef20f87d8c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:26.650709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cc294-42ba-4b99-93b6-4bef20f87d8c None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:26.651408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cc294-42ba-4b99-93b6-4bef20f87d8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:26.652881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cc294-42ba-4b99-93b6-4bef20f87d8c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:26.682931 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 22/46] 10.222.0.73 () {60 vars in 1141 bytes} [Wed Jul 27 17:51:26 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:28.164030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad74f-719a-4523-92b8-19ebdcbd7c8e None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:28.164551 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad74f-719a-4523-92b8-19ebdcbd7c8e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:28.164633 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad74f-719a-4523-92b8-19ebdcbd7c8e None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:28.165951 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 25/47] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:28.171190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbac2b5-91fb-43a9-8155-fb1516dfd64b None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:28.171606 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbac2b5-91fb-43a9-8155-fb1516dfd64b None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:28.171758 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbac2b5-91fb-43a9-8155-fb1516dfd64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:28.190409 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-edbac2b5-91fb-43a9-8155-fb1516dfd64b None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:28.191630 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-edbac2b5-91fb-43a9-8155-fb1516dfd64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:28.257689 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 23/48] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:28.281813 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ad74f-719a-4523-92b8-19ebdcbd7c8e None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:28.350262 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:28.388401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ad74f-719a-4523-92b8-19ebdcbd7c8e None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:28.423541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d1d1c-5367-4655-ba77-d95f3b6d17f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:28.424112 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d1d1c-5367-4655-ba77-d95f3b6d17f9 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:28.424403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d1d1c-5367-4655-ba77-d95f3b6d17f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:28.424684 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d1d1c-5367-4655-ba77-d95f3b6d17f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:28.435598 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d1d1c-5367-4655-ba77-d95f3b6d17f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-772d1d1c-5367-4655-ba77-d95f3b6d17f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:28.440693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:28.441555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:28.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 26/49] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:51:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:28.447697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbac2b5-91fb-43a9-8155-fb1516dfd64b None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:28.532517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:28.548522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbac2b5-91fb-43a9-8155-fb1516dfd64b None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:28.585622 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88430b-a6d9-4977-afb1-e6206a969d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:28.586261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88430b-a6d9-4977-afb1-e6206a969d66 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:28.586584 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88430b-a6d9-4977-afb1-e6206a969d66 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:28.586867 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88430b-a6d9-4977-afb1-e6206a969d66 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:28.587598 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88430b-a6d9-4977-afb1-e6206a969d66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:28.587908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88430b-a6d9-4977-afb1-e6206a969d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:28.589300 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88430b-a6d9-4977-afb1-e6206a969d66 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:28.597837 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 24/50] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:28.603356 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d1d1c-5367-4655-ba77-d95f3b6d17f9 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:28.707338 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d1d1c-5367-4655-ba77-d95f3b6d17f9 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:28.733392 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:28.743041 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae201b9-073b-4a1c-938f-a6e5b5bac3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:28.743699 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae201b9-073b-4a1c-938f-a6e5b5bac3e9 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:28.743998 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae201b9-073b-4a1c-938f-a6e5b5bac3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:28.744280 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae201b9-073b-4a1c-938f-a6e5b5bac3e9 None admin] PATH_INFO: `/v3/users/1c437a71edd54d15a20aca35e290b469` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:28.745771 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae201b9-073b-4a1c-938f-a6e5b5bac3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=1c437a71edd54d15a20aca35e290b469)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:28.747263 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae201b9-073b-4a1c-938f-a6e5b5bac3e9 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:28.748876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 27/51] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:28 2022] GET /identity/v3/users/1c437a71edd54d15a20aca35e290b469 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:28.754468 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88430b-a6d9-4977-afb1-e6206a969d66 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:28.864251 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88430b-a6d9-4977-afb1-e6206a969d66 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:28.900083 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e795e8-eb5a-4db7-8095-59899667cb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:28.900737 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e795e8-eb5a-4db7-8095-59899667cb63 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:28.901021 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e795e8-eb5a-4db7-8095-59899667cb63 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:28.901306 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e795e8-eb5a-4db7-8095-59899667cb63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:28.902500 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e795e8-eb5a-4db7-8095-59899667cb63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:28.903990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e795e8-eb5a-4db7-8095-59899667cb63 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:28.905608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 25/52] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:28.911578 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae201b9-073b-4a1c-938f-a6e5b5bac3e9 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:28.942392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1908f-434c-434a-bcfe-8c2afb448936 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:28.942724 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1908f-434c-434a-bcfe-8c2afb448936 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:28.943006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1908f-434c-434a-bcfe-8c2afb448936 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:28.944354 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 26/53] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:51:28.949228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa6fd-4fff-4561-90f5-fe4941baafa3 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:28.949526 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa6fd-4fff-4561-90f5-fe4941baafa3 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:28.949809 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa6fd-4fff-4561-90f5-fe4941baafa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:28.969910 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-30daa6fd-4fff-4561-90f5-fe4941baafa3 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:28.971085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-30daa6fd-4fff-4561-90f5-fe4941baafa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:28.981989 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:29.028649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae201b9-073b-4a1c-938f-a6e5b5bac3e9 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:29.039468 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 27/54] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:51:29.062305 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ee2ae-df23-4ec7-8396-b18b10ca605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:29.063670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee2ae-df23-4ec7-8396-b18b10ca605e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:29.064000 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee2ae-df23-4ec7-8396-b18b10ca605e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:29.064323 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee2ae-df23-4ec7-8396-b18b10ca605e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:29.064737 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daa6fd-4fff-4561-90f5-fe4941baafa3 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:29.065144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ee2ae-df23-4ec7-8396-b18b10ca605e None admin] RBAC: Adding query filter params (role.id=d6d0c56d1054455c813546a2c761a7d0, scope.domain.id=default, user.id=1c437a71edd54d15a20aca35e290b469) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:29.065457 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ee2ae-df23-4ec7-8396-b18b10ca605e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:29.066929 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ee2ae-df23-4ec7-8396-b18b10ca605e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:29.077682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 28/55] 10.222.0.73 () {56 vars in 1322 bytes} [Wed Jul 27 17:51:28 2022] GET /identity/v3/role_assignments?user.id=1c437a71edd54d15a20aca35e290b469&scope.domain.id=default&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 530 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:29.177577 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daa6fd-4fff-4561-90f5-fe4941baafa3 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:29.213105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2303ce-1b4f-4b47-b4b9-53dafa55a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:29.213768 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2303ce-1b4f-4b47-b4b9-53dafa55a998 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:29.214059 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2303ce-1b4f-4b47-b4b9-53dafa55a998 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:29.214345 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2303ce-1b4f-4b47-b4b9-53dafa55a998 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:29.215593 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2303ce-1b4f-4b47-b4b9-53dafa55a998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:29.217052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2303ce-1b4f-4b47-b4b9-53dafa55a998 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:29.218728 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 28/56] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:29.224818 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ee2ae-df23-4ec7-8396-b18b10ca605e None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:29.288518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:29.332334 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ee2ae-df23-4ec7-8396-b18b10ca605e None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:29.365822 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b86d8-af59-4436-ba9b-6edfdaf79379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:29.366447 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b86d8-af59-4436-ba9b-6edfdaf79379 None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:29.366831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b86d8-af59-4436-ba9b-6edfdaf79379 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:29.367057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b86d8-af59-4436-ba9b-6edfdaf79379 None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:29.367759 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b86d8-af59-4436-ba9b-6edfdaf79379 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:29.369221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b86d8-af59-4436-ba9b-6edfdaf79379 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:29.396523 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 29/57] 10.222.0.73 () {60 vars in 1140 bytes} [Wed Jul 27 17:51:29 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:31.626495 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80292a9-6dc4-4b84-9f62-6d9374e25256 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:31.627041 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80292a9-6dc4-4b84-9f62-6d9374e25256 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:31.627345 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80292a9-6dc4-4b84-9f62-6d9374e25256 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:31.628744 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 29/58] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:31.634212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbff3-daa9-4737-9fa4-10591212f2ba None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:31.634753 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbff3-daa9-4737-9fa4-10591212f2ba None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:31.634842 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbff3-daa9-4737-9fa4-10591212f2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:31.657366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-994bbff3-daa9-4737-9fa4-10591212f2ba None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:31.659399 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-994bbff3-daa9-4737-9fa4-10591212f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:31.726852 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 30/59] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:31.754409 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80292a9-6dc4-4b84-9f62-6d9374e25256 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:31.774382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:31.860895 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80292a9-6dc4-4b84-9f62-6d9374e25256 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:31.893702 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3927d60-d8bb-4a7b-bbc6-aa15efdfced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:31.894278 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3927d60-d8bb-4a7b-bbc6-aa15efdfced6 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:31.894592 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3927d60-d8bb-4a7b-bbc6-aa15efdfced6 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:31.894872 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3927d60-d8bb-4a7b-bbc6-aa15efdfced6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:31.896016 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3927d60-d8bb-4a7b-bbc6-aa15efdfced6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:31.897710 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3927d60-d8bb-4a7b-bbc6-aa15efdfced6 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:31.899315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 30/60] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:31.904853 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bbff3-daa9-4737-9fa4-10591212f2ba None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:31.947829 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:32.012487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bbff3-daa9-4737-9fa4-10591212f2ba None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:32.047523 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1444a-5fbc-4b23-9f8f-624c8c6dc224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:32.048152 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1444a-5fbc-4b23-9f8f-624c8c6dc224 None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:32.048442 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1444a-5fbc-4b23-9f8f-624c8c6dc224 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:32.048725 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1444a-5fbc-4b23-9f8f-624c8c6dc224 None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:32.049428 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1444a-5fbc-4b23-9f8f-624c8c6dc224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:32.050932 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1444a-5fbc-4b23-9f8f-624c8c6dc224 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:32.077671 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 31/61] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:51:31 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:35.347970 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d874-63e4-48db-af16-dbdd846f9322 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:35.348983 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d874-63e4-48db-af16-dbdd846f9322 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:35.349503 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d874-63e4-48db-af16-dbdd846f9322 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:35.351350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 31/62] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:35.356298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b200da-da1d-4aed-9b47-c47f22d719eb None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:35.357099 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b200da-da1d-4aed-9b47-c47f22d719eb None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:35.357636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b200da-da1d-4aed-9b47-c47f22d719eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:35.383655 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-e9b200da-da1d-4aed-9b47-c47f22d719eb None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:35.385246 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-e9b200da-da1d-4aed-9b47-c47f22d719eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:35.474374 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 32/63] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:35.510406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1d874-63e4-48db-af16-dbdd846f9322 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:35.620236 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:35.649661 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1d874-63e4-48db-af16-dbdd846f9322 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:35.696451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd75cc-5d4e-4978-910b-4c1e31b249cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:35.697135 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd75cc-5d4e-4978-910b-4c1e31b249cc None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:35.697424 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd75cc-5d4e-4978-910b-4c1e31b249cc None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:35.697709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd75cc-5d4e-4978-910b-4c1e31b249cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:35.721541 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd75cc-5d4e-4978-910b-4c1e31b249cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-06bd75cc-5d4e-4978-910b-4c1e31b249cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:35.726696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:35.727576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:35.728370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 32/64] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:35.736014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b200da-da1d-4aed-9b47-c47f22d719eb None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:35.805939 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:35.868970 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ff29-d89f-4bf6-a92b-e9e0caca0dd9 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:35.869666 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ff29-d89f-4bf6-a92b-e9e0caca0dd9 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:35.870045 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ff29-d89f-4bf6-a92b-e9e0caca0dd9 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:35.872228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 33/65] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:51:35.877586 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415380fd-521e-4895-92ee-22d012f3a177 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:35.878103 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415380fd-521e-4895-92ee-22d012f3a177 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:35.878614 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415380fd-521e-4895-92ee-22d012f3a177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:35.904917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-415380fd-521e-4895-92ee-22d012f3a177 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:35.906669 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-415380fd-521e-4895-92ee-22d012f3a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:35.925419 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b200da-da1d-4aed-9b47-c47f22d719eb None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:35.982993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1579f0b-2815-45d1-876d-110c68717e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:35.983633 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1579f0b-2815-45d1-876d-110c68717e73 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:35.983921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1579f0b-2815-45d1-876d-110c68717e73 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:35.984202 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1579f0b-2815-45d1-876d-110c68717e73 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:35.985638 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1579f0b-2815-45d1-876d-110c68717e73 None admin] RBAC: Adding query filter params (name=member) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:35.986024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1579f0b-2815-45d1-876d-110c68717e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:35.988101 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1579f0b-2815-45d1-876d-110c68717e73 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:36.002849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 34/66] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:51:36.004514 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57549c16-1c25-48a3-819b-09f24a968f4a None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.005009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57549c16-1c25-48a3-819b-09f24a968f4a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.005511 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57549c16-1c25-48a3-819b-09f24a968f4a None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.007084 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 35/67] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:36.010731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 33/68] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:51:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:36.016433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57549c16-1c25-48a3-819b-09f24a968f4a None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:36.030711 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3439d3-7dd0-4471-b1df-11327de57a36 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.031316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3439d3-7dd0-4471-b1df-11327de57a36 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.032380 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3439d3-7dd0-4471-b1df-11327de57a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.053258 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-3c3439d3-7dd0-4471-b1df-11327de57a36 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:36.055028 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-3c3439d3-7dd0-4471-b1df-11327de57a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:36.111189 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:36.131035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 34/69] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 17:51:36.131874 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3439d3-7dd0-4471-b1df-11327de57a36 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:36.152948 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:36.159636 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57549c16-1c25-48a3-819b-09f24a968f4a None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:36.196967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c8934-f9b5-4623-bdb2-0af8d9082ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:36.197617 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c8934-f9b5-4623-bdb2-0af8d9082ce1 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.197903 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c8934-f9b5-4623-bdb2-0af8d9082ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.198182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c8934-f9b5-4623-bdb2-0af8d9082ce1 None admin] PATH_INFO: `/v3/users/16e1cb5a7f654af08a1dedd2f065c65d` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.213073 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c8934-f9b5-4623-bdb2-0af8d9082ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=16e1cb5a7f654af08a1dedd2f065c65d)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:36.214588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c8934-f9b5-4623-bdb2-0af8d9082ce1 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:36.220710 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 36/70] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:36 2022] GET /identity/v3/users/16e1cb5a7f654af08a1dedd2f065c65d => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:36.220710 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa6a42-5dbc-46cf-9aef-86477ece51a3 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.220710 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa6a42-5dbc-46cf-9aef-86477ece51a3 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.220710 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa6a42-5dbc-46cf-9aef-86477ece51a3 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.220710 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 37/71] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:36.220710 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa6a42-5dbc-46cf-9aef-86477ece51a3 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:36.246751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3439d3-7dd0-4471-b1df-11327de57a36 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:36.283105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3ec92-a142-4682-959f-8d6b689b5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:36.283763 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3ec92-a142-4682-959f-8d6b689b5df0 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.284052 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3ec92-a142-4682-959f-8d6b689b5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.284339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3ec92-a142-4682-959f-8d6b689b5df0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.295192 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3ec92-a142-4682-959f-8d6b689b5df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-b0b3ec92-a142-4682-959f-8d6b689b5df0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:36.300610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:36.301675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 35/72] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:51:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:36.302599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3ec92-a142-4682-959f-8d6b689b5df0 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:36.339041 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa6a42-5dbc-46cf-9aef-86477ece51a3 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:36.367458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:36.373760 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe63589-8eee-4fff-9284-85e336bdf1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:36.374401 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe63589-8eee-4fff-9284-85e336bdf1d3 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.374711 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe63589-8eee-4fff-9284-85e336bdf1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.374990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe63589-8eee-4fff-9284-85e336bdf1d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.382398 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:36.386132 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe63589-8eee-4fff-9284-85e336bdf1d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-4fe63589-8eee-4fff-9284-85e336bdf1d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:36.391856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:36.392722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:36.393508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 38/73] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:51:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:36.394662 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430bf22-edb0-4fc8-85ca-5f5219bee068 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.394953 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430bf22-edb0-4fc8-85ca-5f5219bee068 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.395234 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430bf22-edb0-4fc8-85ca-5f5219bee068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.409435 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3ec92-a142-4682-959f-8d6b689b5df0 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:36.413531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-8430bf22-edb0-4fc8-85ca-5f5219bee068 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:36.414770 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-8430bf22-edb0-4fc8-85ca-5f5219bee068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:36.444763 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e0590-2977-45af-8b7b-fdf0fa3e21f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:36.445394 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e0590-2977-45af-8b7b-fdf0fa3e21f2 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.445685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e0590-2977-45af-8b7b-fdf0fa3e21f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.445968 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e0590-2977-45af-8b7b-fdf0fa3e21f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.482758 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 39/74] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:36.484028 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f767c-37cd-4b03-a159-bcdc24a20c3b None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.484317 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f767c-37cd-4b03-a159-bcdc24a20c3b None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.484596 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f767c-37cd-4b03-a159-bcdc24a20c3b None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.486542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 40/75] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:36.487236 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f767c-37cd-4b03-a159-bcdc24a20c3b None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:36.525704 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e0590-2977-45af-8b7b-fdf0fa3e21f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:36.527301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e0590-2977-45af-8b7b-fdf0fa3e21f2 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:36.602033 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f767c-37cd-4b03-a159-bcdc24a20c3b None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:36.609936 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:36.622091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:36.632804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 36/76] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:36.633820 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e0590-2977-45af-8b7b-fdf0fa3e21f2 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:36.640699 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7c199-3759-43d9-8597-4d9ac0ccb5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:36.641975 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7c199-3759-43d9-8597-4d9ac0ccb5cc None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.642270 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7c199-3759-43d9-8597-4d9ac0ccb5cc None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.642687 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7c199-3759-43d9-8597-4d9ac0ccb5cc None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.643421 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7c199-3759-43d9-8597-4d9ac0ccb5cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:36.643736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7c199-3759-43d9-8597-4d9ac0ccb5cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:36.645137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7c199-3759-43d9-8597-4d9ac0ccb5cc None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:36.654335 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 41/77] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:36.655568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a18b3-e3cd-4373-97d9-8e77c1d459af None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.655858 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a18b3-e3cd-4373-97d9-8e77c1d459af None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.656137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a18b3-e3cd-4373-97d9-8e77c1d459af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.674101 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-cd3a18b3-e3cd-4373-97d9-8e77c1d459af None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:36.675362 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-cd3a18b3-e3cd-4373-97d9-8e77c1d459af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:36.738520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e0590-2977-45af-8b7b-fdf0fa3e21f2 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:36.744470 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 42/78] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:36.745348 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a18b3-e3cd-4373-97d9-8e77c1d459af None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:36.780244 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05156a2-3e4d-48ee-86e4-253c118ab2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:36.780879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05156a2-3e4d-48ee-86e4-253c118ab2df None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.781171 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05156a2-3e4d-48ee-86e4-253c118ab2df None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.781454 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05156a2-3e4d-48ee-86e4-253c118ab2df None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.782469 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05156a2-3e4d-48ee-86e4-253c118ab2df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:36.782817 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05156a2-3e4d-48ee-86e4-253c118ab2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:36.784210 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05156a2-3e4d-48ee-86e4-253c118ab2df None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:36.796705 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 37/79] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:51:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:36.796705 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05156a2-3e4d-48ee-86e4-253c118ab2df None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:36.840229 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:36.861247 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a18b3-e3cd-4373-97d9-8e77c1d459af None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:36.874209 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:36.895621 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb4db5-1dff-4ac4-be28-4339bfc78f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:36.896191 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb4db5-1dff-4ac4-be28-4339bfc78f18 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.896475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb4db5-1dff-4ac4-be28-4339bfc78f18 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.896759 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb4db5-1dff-4ac4-be28-4339bfc78f18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.899754 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05156a2-3e4d-48ee-86e4-253c118ab2df None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:36.907496 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb4db5-1dff-4ac4-be28-4339bfc78f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-aebb4db5-1dff-4ac4-be28-4339bfc78f18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:36.912374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:36.913239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:36.914017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 43/80] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:36.914987 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb4db5-1dff-4ac4-be28-4339bfc78f18 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:36.939593 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cacd3-eacf-4e5c-aa0b-3a217afb7b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:36.940245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cacd3-eacf-4e5c-aa0b-3a217afb7b53 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:36.940533 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cacd3-eacf-4e5c-aa0b-3a217afb7b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:36.940816 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cacd3-eacf-4e5c-aa0b-3a217afb7b53 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:36.942020 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cacd3-eacf-4e5c-aa0b-3a217afb7b53 None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:36.943493 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cacd3-eacf-4e5c-aa0b-3a217afb7b53 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:36.945173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 38/81] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:36 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:36.945946 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cacd3-eacf-4e5c-aa0b-3a217afb7b53 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:37.013789 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb4db5-1dff-4ac4-be28-4339bfc78f18 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:37.058443 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784105be-71d3-4d54-bdd6-6387fa579537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:37.059125 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784105be-71d3-4d54-bdd6-6387fa579537 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:37.059405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784105be-71d3-4d54-bdd6-6387fa579537 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:37.059683 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784105be-71d3-4d54-bdd6-6387fa579537 None admin] PATH_INFO: `/v3/users/1c437a71edd54d15a20aca35e290b469` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:37.060259 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cacd3-eacf-4e5c-aa0b-3a217afb7b53 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:37.061035 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784105be-71d3-4d54-bdd6-6387fa579537 None admin] RBAC: Authorizing `identity:get_user(user_id=1c437a71edd54d15a20aca35e290b469)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:37.062545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784105be-71d3-4d54-bdd6-6387fa579537 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:37.065043 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 44/82] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:36 2022] GET /identity/v3/users/1c437a71edd54d15a20aca35e290b469 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:37.065656 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784105be-71d3-4d54-bdd6-6387fa579537 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:37.072151 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:37.098476 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec671e-ef59-49b8-a8d4-991aa5d64106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:37.099153 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec671e-ef59-49b8-a8d4-991aa5d64106 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:37.099433 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec671e-ef59-49b8-a8d4-991aa5d64106 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:37.099718 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec671e-ef59-49b8-a8d4-991aa5d64106 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:37.100875 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec671e-ef59-49b8-a8d4-991aa5d64106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:37.102337 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec671e-ef59-49b8-a8d4-991aa5d64106 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:37.103977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 39/83] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:37.104746 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec671e-ef59-49b8-a8d4-991aa5d64106 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:37.111339 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:37.170788 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784105be-71d3-4d54-bdd6-6387fa579537 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:37.203488 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec671e-ef59-49b8-a8d4-991aa5d64106 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:37.204589 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeab407-7157-441b-b453-5dc1cc351444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:37.205266 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab407-7157-441b-b453-5dc1cc351444 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:37.205571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab407-7157-441b-b453-5dc1cc351444 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:37.205827 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab407-7157-441b-b453-5dc1cc351444 None admin] PATH_INFO: `/v3/users/16e1cb5a7f654af08a1dedd2f065c65d` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:37.207015 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeab407-7157-441b-b453-5dc1cc351444 None admin] RBAC: Authorizing `identity:get_user(user_id=16e1cb5a7f654af08a1dedd2f065c65d)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:37.208750 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeab407-7157-441b-b453-5dc1cc351444 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:37.210352 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 45/84] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:37 2022] GET /identity/v3/users/16e1cb5a7f654af08a1dedd2f065c65d => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:37.212303 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeab407-7157-441b-b453-5dc1cc351444 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:37.240434 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985749-870c-413e-9fb3-306bead32575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:37.241324 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985749-870c-413e-9fb3-306bead32575 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:37.241619 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985749-870c-413e-9fb3-306bead32575 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:37.241907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985749-870c-413e-9fb3-306bead32575 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:37.242671 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86985749-870c-413e-9fb3-306bead32575 None admin] RBAC: Adding query filter params (name=member) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:37.242985 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86985749-870c-413e-9fb3-306bead32575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:37.244383 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86985749-870c-413e-9fb3-306bead32575 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:37.253671 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 40/85] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:51:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:37.254488 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985749-870c-413e-9fb3-306bead32575 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:37.294121 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:37.320365 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeab407-7157-441b-b453-5dc1cc351444 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:37.331806 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:37.356333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985749-870c-413e-9fb3-306bead32575 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:37.356822 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48026d97-1b3e-47fe-88ca-f4216da438bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:37.357441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48026d97-1b3e-47fe-88ca-f4216da438bb None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:37.357732 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48026d97-1b3e-47fe-88ca-f4216da438bb None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:37.358017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48026d97-1b3e-47fe-88ca-f4216da438bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:37.358857 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48026d97-1b3e-47fe-88ca-f4216da438bb None admin] RBAC: Adding query filter params (role.id=a2eb0e476c1f497888d73bb1d1771d16, scope.project.id=4a43597721514990bc6b893382806592, user.id=16e1cb5a7f654af08a1dedd2f065c65d) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:37.359190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48026d97-1b3e-47fe-88ca-f4216da438bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:37.361363 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48026d97-1b3e-47fe-88ca-f4216da438bb None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:37.367026 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 46/86] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:37 2022] GET /identity/v3/role_assignments?user.id=16e1cb5a7f654af08a1dedd2f065c65d&scope.project.id=4a43597721514990bc6b893382806592&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:37.367804 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48026d97-1b3e-47fe-88ca-f4216da438bb None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:37.394415 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a038f8a-0c73-490c-8b93-20c33496e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:37.395756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a038f8a-0c73-490c-8b93-20c33496e57f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:37.396209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a038f8a-0c73-490c-8b93-20c33496e57f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:37.396490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a038f8a-0c73-490c-8b93-20c33496e57f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:37.475248 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a038f8a-0c73-490c-8b93-20c33496e57f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:37.476679 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a038f8a-0c73-490c-8b93-20c33496e57f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:37.486207 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48026d97-1b3e-47fe-88ca-f4216da438bb None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:37.520995 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:37.527015 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9d997-dcdd-40de-87a2-8d694cee5405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:37.527895 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d997-dcdd-40de-87a2-8d694cee5405 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:37.528449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d997-dcdd-40de-87a2-8d694cee5405 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:37.528926 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d997-dcdd-40de-87a2-8d694cee5405 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:37.529795 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9d997-dcdd-40de-87a2-8d694cee5405 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:37.531553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9d997-dcdd-40de-87a2-8d694cee5405 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:37.581545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 47/87] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:51:37 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:37.582924 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9d997-dcdd-40de-87a2-8d694cee5405 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:37.597360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 41/88] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:37.598072 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a038f8a-0c73-490c-8b93-20c33496e57f None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:37.630599 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:37.719682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a038f8a-0c73-490c-8b93-20c33496e57f None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:37.725745 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9d997-dcdd-40de-87a2-8d694cee5405 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:37.757586 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521eca-a3c1-4945-972d-ef8709af781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:37.758539 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521eca-a3c1-4945-972d-ef8709af781d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:37.758839 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521eca-a3c1-4945-972d-ef8709af781d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:37.759125 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521eca-a3c1-4945-972d-ef8709af781d None admin] PATH_INFO: `/v3/users/16e1cb5a7f654af08a1dedd2f065c65d` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:37.763234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca521eca-a3c1-4945-972d-ef8709af781d None admin] RBAC: Authorizing `identity:get_user(user_id=16e1cb5a7f654af08a1dedd2f065c65d)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:37.764710 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca521eca-a3c1-4945-972d-ef8709af781d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:37.767870 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 42/89] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:37 2022] GET /identity/v3/users/16e1cb5a7f654af08a1dedd2f065c65d => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:37.768669 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521eca-a3c1-4945-972d-ef8709af781d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:37.769710 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e0c3b-98a1-4e9d-a3c9-c2a907c36ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:37.770364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e0c3b-98a1-4e9d-a3c9-c2a907c36ff3 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:37.770688 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e0c3b-98a1-4e9d-a3c9-c2a907c36ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:37.770974 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e0c3b-98a1-4e9d-a3c9-c2a907c36ff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:37.778313 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:37.855970 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e0c3b-98a1-4e9d-a3c9-c2a907c36ff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:37.857476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e0c3b-98a1-4e9d-a3c9-c2a907c36ff3 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:37.896068 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:37.909145 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521eca-a3c1-4945-972d-ef8709af781d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:37.959916 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74c798-54a0-446f-becc-87eab770e02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:37.960938 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74c798-54a0-446f-becc-87eab770e02e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:37.961444 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74c798-54a0-446f-becc-87eab770e02e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:37.961920 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74c798-54a0-446f-becc-87eab770e02e None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:37.965028 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74c798-54a0-446f-becc-87eab770e02e None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:37.966482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74c798-54a0-446f-becc-87eab770e02e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:37.968258 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 43/90] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:37 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:37.969998 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74c798-54a0-446f-becc-87eab770e02e None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:37.995366 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 48/91] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:37.996167 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e0c3b-98a1-4e9d-a3c9-c2a907c36ff3 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:38.058032 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:38.092140 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74c798-54a0-446f-becc-87eab770e02e None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:38.133937 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f336b-0d32-4056-8c41-857f727a6528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:38.134783 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e0c3b-98a1-4e9d-a3c9-c2a907c36ff3 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:38.135206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f336b-0d32-4056-8c41-857f727a6528 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:38.135694 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f336b-0d32-4056-8c41-857f727a6528 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:38.136405 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f336b-0d32-4056-8c41-857f727a6528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:38.169063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:38.184209 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008b6b8-fbac-4907-834d-a5048a0d106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:38.185898 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b6b8-fbac-4907-834d-a5048a0d106e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:38.186394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b6b8-fbac-4907-834d-a5048a0d106e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:38.186926 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b6b8-fbac-4907-834d-a5048a0d106e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:38.188602 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008b6b8-fbac-4907-834d-a5048a0d106e None admin] RBAC: Adding query filter params (role.id=d6d0c56d1054455c813546a2c761a7d0, scope.project.id=4a43597721514990bc6b893382806592, user.id=1c437a71edd54d15a20aca35e290b469) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:38.189747 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008b6b8-fbac-4907-834d-a5048a0d106e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:38.192120 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008b6b8-fbac-4907-834d-a5048a0d106e None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:38.200741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 49/92] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:37 2022] GET /identity/v3/role_assignments?user.id=1c437a71edd54d15a20aca35e290b469&scope.project.id=4a43597721514990bc6b893382806592&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:38.202154 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008b6b8-fbac-4907-834d-a5048a0d106e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:38.217809 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f336b-0d32-4056-8c41-857f727a6528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:38.220089 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f336b-0d32-4056-8c41-857f727a6528 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:38.344751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:38.382453 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 44/93] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:38.391215 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f336b-0d32-4056-8c41-857f727a6528 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:38.412964 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008b6b8-fbac-4907-834d-a5048a0d106e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:38.483430 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d95542-4ef0-4dfe-a1bd-416e91aecc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:38.484120 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d95542-4ef0-4dfe-a1bd-416e91aecc4c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:38.484413 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d95542-4ef0-4dfe-a1bd-416e91aecc4c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:38.484700 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d95542-4ef0-4dfe-a1bd-416e91aecc4c None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:38.491183 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d95542-4ef0-4dfe-a1bd-416e91aecc4c None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:38.491183 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d95542-4ef0-4dfe-a1bd-416e91aecc4c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:38.491183 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 50/94] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:38 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:38.497076 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d95542-4ef0-4dfe-a1bd-416e91aecc4c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:38.578487 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:38.589587 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f336b-0d32-4056-8c41-857f727a6528 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:38.637128 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d95542-4ef0-4dfe-a1bd-416e91aecc4c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:38.656420 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030b408-a96f-46d6-a847-15b0d8609cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:38.657380 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030b408-a96f-46d6-a847-15b0d8609cc3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:38.657807 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030b408-a96f-46d6-a847-15b0d8609cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:38.658361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030b408-a96f-46d6-a847-15b0d8609cc3 None admin] PATH_INFO: `/v3/projects/366b886b290347488f3c24b82c1ff387` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:38.663384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030b408-a96f-46d6-a847-15b0d8609cc3 None admin] RBAC: Authorizing `identity:get_project(project_id=366b886b290347488f3c24b82c1ff387)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:38.665049 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030b408-a96f-46d6-a847-15b0d8609cc3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:38.667102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 45/95] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:38 2022] GET /identity/v3/projects/366b886b290347488f3c24b82c1ff387 => generated 312 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:38.675914 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030b408-a96f-46d6-a847-15b0d8609cc3 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:38.682022 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2d7ad-c96f-4cfb-8776-548609459e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:38.683719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2d7ad-c96f-4cfb-8776-548609459e96 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:38.684117 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2d7ad-c96f-4cfb-8776-548609459e96 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:38.684508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2d7ad-c96f-4cfb-8776-548609459e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:38.685463 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2d7ad-c96f-4cfb-8776-548609459e96 None admin] RBAC: Adding query filter params (role.id=4ff7ba49d92f490cba2d9ef2f9a36e79, scope.project.id=4a43597721514990bc6b893382806592, user.id=16e1cb5a7f654af08a1dedd2f065c65d) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:38.685928 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2d7ad-c96f-4cfb-8776-548609459e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:38.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2d7ad-c96f-4cfb-8776-548609459e96 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:38.700250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 51/96] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:38 2022] GET /identity/v3/role_assignments?user.id=16e1cb5a7f654af08a1dedd2f065c65d&scope.project.id=4a43597721514990bc6b893382806592&role.id=4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:38.768533 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:38.851322 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030b408-a96f-46d6-a847-15b0d8609cc3 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:38.907544 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8d79d-9b35-4d73-8e20-799eea513e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:38.908432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d79d-9b35-4d73-8e20-799eea513e7d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:38.908861 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d79d-9b35-4d73-8e20-799eea513e7d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:38.909281 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d79d-9b35-4d73-8e20-799eea513e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:38.910313 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8d79d-9b35-4d73-8e20-799eea513e7d None admin] RBAC: Adding query filter params (role.id=a2eb0e476c1f497888d73bb1d1771d16, scope.project.id=366b886b290347488f3c24b82c1ff387, user.id=16e1cb5a7f654af08a1dedd2f065c65d) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:38.914901 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8d79d-9b35-4d73-8e20-799eea513e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:38.916606 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8d79d-9b35-4d73-8e20-799eea513e7d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:38.923460 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 46/97] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:38 2022] GET /identity/v3/role_assignments?user.id=16e1cb5a7f654af08a1dedd2f065c65d&scope.project.id=366b886b290347488f3c24b82c1ff387&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:40.269297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64580f63-a13e-416d-bd77-228745800f09 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:40.269802 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64580f63-a13e-416d-bd77-228745800f09 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:40.269872 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64580f63-a13e-416d-bd77-228745800f09 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:40.271537 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 52/98] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:40.276907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7f47d-36c7-4d21-bb29-44c779f124ff None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:40.277731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7f47d-36c7-4d21-bb29-44c779f124ff None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:40.278203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7f47d-36c7-4d21-bb29-44c779f124ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:40.314413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-e5b7f47d-36c7-4d21-bb29-44c779f124ff None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:40.315962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-e5b7f47d-36c7-4d21-bb29-44c779f124ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:40.398773 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 47/99] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:40.440169 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64580f63-a13e-416d-bd77-228745800f09 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:40.602130 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64580f63-a13e-416d-bd77-228745800f09 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:40.638061 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:40.650397 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a642ea8-8531-4d32-8e6b-22b71ca66286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:40.651084 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a642ea8-8531-4d32-8e6b-22b71ca66286 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:40.651368 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a642ea8-8531-4d32-8e6b-22b71ca66286 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:40.651650 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a642ea8-8531-4d32-8e6b-22b71ca66286 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:40.670685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a642ea8-8531-4d32-8e6b-22b71ca66286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-6a642ea8-8531-4d32-8e6b-22b71ca66286 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:40.676635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:40.677532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:40.678328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 53/100] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:51:40.685027 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7f47d-36c7-4d21-bb29-44c779f124ff None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:40.760722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:40.862848 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7f47d-36c7-4d21-bb29-44c779f124ff None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:40.906234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd810dd6-1ee3-41b4-99f8-712308829fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:40.907052 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd810dd6-1ee3-41b4-99f8-712308829fca None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:40.907344 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd810dd6-1ee3-41b4-99f8-712308829fca None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:40.907623 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd810dd6-1ee3-41b4-99f8-712308829fca None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:40.908465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd810dd6-1ee3-41b4-99f8-712308829fca None admin] RBAC: Adding query filter params (name=member) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:40.908775 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd810dd6-1ee3-41b4-99f8-712308829fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:40.910160 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd810dd6-1ee3-41b4-99f8-712308829fca None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:40.924070 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 48/101] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:51:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:40.930142 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a642ea8-8531-4d32-8e6b-22b71ca66286 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:41.087542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a642ea8-8531-4d32-8e6b-22b71ca66286 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:41.142945 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fce344-a745-432c-a5f7-2c41fb15ecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:41.143578 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fce344-a745-432c-a5f7-2c41fb15ecf5 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:41.143865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fce344-a745-432c-a5f7-2c41fb15ecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:41.144149 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fce344-a745-432c-a5f7-2c41fb15ecf5 None admin] PATH_INFO: `/v3/users/16e1cb5a7f654af08a1dedd2f065c65d` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:41.148229 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fce344-a745-432c-a5f7-2c41fb15ecf5 None admin] RBAC: Authorizing `identity:get_user(user_id=16e1cb5a7f654af08a1dedd2f065c65d)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:41.149780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fce344-a745-432c-a5f7-2c41fb15ecf5 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:41.151959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 54/102] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:40 2022] GET /identity/v3/users/16e1cb5a7f654af08a1dedd2f065c65d => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:41.158447 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd810dd6-1ee3-41b4-99f8-712308829fca None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:41.324588 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:41.333315 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd810dd6-1ee3-41b4-99f8-712308829fca None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:41.351768 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3276a6-bbb9-4b69-8ad7-917dbe4ae3a2 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:41.352257 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3276a6-bbb9-4b69-8ad7-917dbe4ae3a2 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:41.352362 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3276a6-bbb9-4b69-8ad7-917dbe4ae3a2 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:41.353687 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 55/103] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:41.360425 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11bb9-457f-4320-ae8b-685d3c491d4b None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:41.360724 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11bb9-457f-4320-ae8b-685d3c491d4b None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:41.361140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11bb9-457f-4320-ae8b-685d3c491d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:41.370761 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14598b62-9558-47e9-b75b-16cee3c7c434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:41.371523 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14598b62-9558-47e9-b75b-16cee3c7c434 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:41.371825 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14598b62-9558-47e9-b75b-16cee3c7c434 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:41.372118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14598b62-9558-47e9-b75b-16cee3c7c434 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:41.373305 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14598b62-9558-47e9-b75b-16cee3c7c434 None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:41.374809 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14598b62-9558-47e9-b75b-16cee3c7c434 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:41.381527 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 49/104] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:41 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:41.382387 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14598b62-9558-47e9-b75b-16cee3c7c434 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:41.408304 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-85a11bb9-457f-4320-ae8b-685d3c491d4b None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:41.409493 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-85a11bb9-457f-4320-ae8b-685d3c491d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:41.470913 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:41.492277 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 56/105] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:41.493681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97203093-1a34-43e6-a025-b06f62fcd5f6 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:41.493983 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97203093-1a34-43e6-a025-b06f62fcd5f6 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:41.494369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97203093-1a34-43e6-a025-b06f62fcd5f6 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:41.495818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 57/106] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:41.496685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aadcd-910b-4177-9076-4718c6766fc2 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:41.496979 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aadcd-910b-4177-9076-4718c6766fc2 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:41.497265 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aadcd-910b-4177-9076-4718c6766fc2 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:41.498648 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 58/107] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:41.506661 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0a61d-2112-4c17-b0e0-f377a2dbd59c None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:41.506952 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0a61d-2112-4c17-b0e0-f377a2dbd59c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:41.507238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0a61d-2112-4c17-b0e0-f377a2dbd59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:41.534038 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-90d0a61d-2112-4c17-b0e0-f377a2dbd59c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:41.535281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-90d0a61d-2112-4c17-b0e0-f377a2dbd59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:41.546089 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14598b62-9558-47e9-b75b-16cee3c7c434 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:41.583047 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314af344-54ad-43cd-a74a-5f57c031c634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:41.583794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af344-54ad-43cd-a74a-5f57c031c634 None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:41.584084 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af344-54ad-43cd-a74a-5f57c031c634 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:41.584359 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af344-54ad-43cd-a74a-5f57c031c634 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592/users/16e1cb5a7f654af08a1dedd2f065c65d/roles/a2eb0e476c1f497888d73bb1d1771d16` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:41.586426 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314af344-54ad-43cd-a74a-5f57c031c634 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a43597721514990bc6b893382806592, user_id=16e1cb5a7f654af08a1dedd2f065c65d, role_id=a2eb0e476c1f497888d73bb1d1771d16)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:41.588015 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314af344-54ad-43cd-a74a-5f57c031c634 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:41.606911 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 50/108] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:51:41 2022] PUT /identity/v3/projects/4a43597721514990bc6b893382806592/users/16e1cb5a7f654af08a1dedd2f065c65d/roles/a2eb0e476c1f497888d73bb1d1771d16 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:51:41.608127 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557933dc-c257-404a-9318-0e5b1ae533f5 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:41.608461 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557933dc-c257-404a-9318-0e5b1ae533f5 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:41.608791 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557933dc-c257-404a-9318-0e5b1ae533f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:41.613283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 59/109] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:51:41.614291 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0a61d-2112-4c17-b0e0-f377a2dbd59c None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:41.639830 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-557933dc-c257-404a-9318-0e5b1ae533f5 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:41.642688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-557933dc-c257-404a-9318-0e5b1ae533f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:41.695921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:41.794500 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0a61d-2112-4c17-b0e0-f377a2dbd59c None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:41.820274 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:41.823042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 51/110] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:41.824429 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557933dc-c257-404a-9318-0e5b1ae533f5 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:41.942110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c65e5-799d-441d-a6c9-fea862392580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:41.942110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c65e5-799d-441d-a6c9-fea862392580 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:41.942444 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c65e5-799d-441d-a6c9-fea862392580 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:41.943760 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c65e5-799d-441d-a6c9-fea862392580 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:41.944682 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c65e5-799d-441d-a6c9-fea862392580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:41.946220 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c65e5-799d-441d-a6c9-fea862392580 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:41.952219 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 60/111] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:41.952219 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c65e5-799d-441d-a6c9-fea862392580 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:42.065676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557933dc-c257-404a-9318-0e5b1ae533f5 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:42.077972 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c65e5-799d-441d-a6c9-fea862392580 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:42.119068 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91a35-8b5a-4c80-bbc2-09d0fc75c08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:42.120209 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91a35-8b5a-4c80-bbc2-09d0fc75c08f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:42.120706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91a35-8b5a-4c80-bbc2-09d0fc75c08f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:42.121174 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91a35-8b5a-4c80-bbc2-09d0fc75c08f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:42.134488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db91a35-8b5a-4c80-bbc2-09d0fc75c08f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-8db91a35-8b5a-4c80-bbc2-09d0fc75c08f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:42.140453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:42.141608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:42.142465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:42.145242 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 61/112] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:51:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:42.146277 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91a35-8b5a-4c80-bbc2-09d0fc75c08f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:42.179930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41004069-9963-46cf-bf14-efcdbf13ce74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:42.180604 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41004069-9963-46cf-bf14-efcdbf13ce74 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:42.180897 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41004069-9963-46cf-bf14-efcdbf13ce74 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:42.181175 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41004069-9963-46cf-bf14-efcdbf13ce74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:42.199399 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:42.211562 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41004069-9963-46cf-bf14-efcdbf13ce74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-41004069-9963-46cf-bf14-efcdbf13ce74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:42.216577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:42.217456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:42.218221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 52/113] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:42.227574 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41004069-9963-46cf-bf14-efcdbf13ce74 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:42.277398 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91a35-8b5a-4c80-bbc2-09d0fc75c08f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:42.284656 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:42.321727 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce61af-45b9-43eb-9f01-ce647c8546f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:42.323285 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce61af-45b9-43eb-9f01-ce647c8546f9 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:42.323908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce61af-45b9-43eb-9f01-ce647c8546f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:42.324819 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce61af-45b9-43eb-9f01-ce647c8546f9 None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:42.325788 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce61af-45b9-43eb-9f01-ce647c8546f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:42.328222 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce61af-45b9-43eb-9f01-ce647c8546f9 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:42.361019 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 62/114] 10.222.0.73 () {60 vars in 1141 bytes} [Wed Jul 27 17:51:42 2022] POST /identity/v3/projects => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:42.370314 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce61af-45b9-43eb-9f01-ce647c8546f9 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:42.494102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41004069-9963-46cf-bf14-efcdbf13ce74 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:42.539673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:42.553846 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce61af-45b9-43eb-9f01-ce647c8546f9 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:42.595491 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fccead-cd5b-4360-8417-99563489784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:42.596382 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccead-cd5b-4360-8417-99563489784e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:42.596677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccead-cd5b-4360-8417-99563489784e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:42.596963 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccead-cd5b-4360-8417-99563489784e None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:42.597820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d05aa9-6766-4530-92e6-6d489025d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:42.597952 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fccead-cd5b-4360-8417-99563489784e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:42.598131 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fccead-cd5b-4360-8417-99563489784e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:42.598463 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d05aa9-6766-4530-92e6-6d489025d75d None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:42.598785 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d05aa9-6766-4530-92e6-6d489025d75d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:42.599070 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d05aa9-6766-4530-92e6-6d489025d75d None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:42.599600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fccead-cd5b-4360-8417-99563489784e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:42.599806 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d05aa9-6766-4530-92e6-6d489025d75d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:42.600124 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d05aa9-6766-4530-92e6-6d489025d75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:42.601544 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d05aa9-6766-4530-92e6-6d489025d75d None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:42.611764 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 63/115] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:51:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:42.611971 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 53/116] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:42.612726 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf98f2-5ef7-4a1c-9281-c04a2de2b231 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:42.612957 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1258f2-ae4e-4286-902f-5e25b99c0ef0 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:42.613059 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf98f2-5ef7-4a1c-9281-c04a2de2b231 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:42.613253 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1258f2-ae4e-4286-902f-5e25b99c0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:42.613357 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf98f2-5ef7-4a1c-9281-c04a2de2b231 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:42.613539 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1258f2-ae4e-4286-902f-5e25b99c0ef0 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:42.619377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 64/117] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:42.619744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 54/118] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:42.620397 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f1ac3-c9da-48ee-b141-f5c7d1e75f09 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:42.620596 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1258f2-ae4e-4286-902f-5e25b99c0ef0 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:42.620687 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f1ac3-c9da-48ee-b141-f5c7d1e75f09 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:42.621033 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f1ac3-c9da-48ee-b141-f5c7d1e75f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:42.643269 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-5a3f1ac3-c9da-48ee-b141-f5c7d1e75f09 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:42.644845 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-5a3f1ac3-c9da-48ee-b141-f5c7d1e75f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:42.731560 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:42.734312 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 65/119] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:51:42.735873 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f1ac3-c9da-48ee-b141-f5c7d1e75f09 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:42.766923 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1258f2-ae4e-4286-902f-5e25b99c0ef0 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:42.818303 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90b82e-3327-4641-8398-eab807d9ff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:42.819414 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90b82e-3327-4641-8398-eab807d9ff62 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:42.820142 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90b82e-3327-4641-8398-eab807d9ff62 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:42.820853 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90b82e-3327-4641-8398-eab807d9ff62 None admin] PATH_INFO: `/v3/users/1c437a71edd54d15a20aca35e290b469` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:42.822354 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90b82e-3327-4641-8398-eab807d9ff62 None admin] RBAC: Authorizing `identity:get_user(user_id=1c437a71edd54d15a20aca35e290b469)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:42.824599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90b82e-3327-4641-8398-eab807d9ff62 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:42.827192 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 55/120] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:42 2022] GET /identity/v3/users/1c437a71edd54d15a20aca35e290b469 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:42.828623 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f3ecf-6cb7-4ea0-b6ba-39d52121d0e7 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:42.829205 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f3ecf-6cb7-4ea0-b6ba-39d52121d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:42.830042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f3ecf-6cb7-4ea0-b6ba-39d52121d0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:42.853901 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:42.855507 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-015f3ecf-6cb7-4ea0-b6ba-39d52121d0e7 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:42.857179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-015f3ecf-6cb7-4ea0-b6ba-39d52121d0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:42.875959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f1ac3-c9da-48ee-b141-f5c7d1e75f09 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:42.921809 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154ab28-55c0-4036-aaba-8bcbee93ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:42.923052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ab28-55c0-4036-aaba-8bcbee93ba4c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:42.923726 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ab28-55c0-4036-aaba-8bcbee93ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:42.924414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ab28-55c0-4036-aaba-8bcbee93ba4c None admin] PATH_INFO: `/v3/users/2a1eb1b33be547eb8d4d39a874447186` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:42.945250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154ab28-55c0-4036-aaba-8bcbee93ba4c None admin] RBAC: Authorizing `identity:get_user(user_id=2a1eb1b33be547eb8d4d39a874447186)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:42.945864 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 56/121] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:42.947457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154ab28-55c0-4036-aaba-8bcbee93ba4c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:42.949639 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 66/122] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:42 2022] GET /identity/v3/users/2a1eb1b33be547eb8d4d39a874447186 => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:42.950725 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154ab28-55c0-4036-aaba-8bcbee93ba4c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:42.951503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f3ecf-6cb7-4ea0-b6ba-39d52121d0e7 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:43.074765 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:43.099247 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154ab28-55c0-4036-aaba-8bcbee93ba4c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:43.103936 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f3ecf-6cb7-4ea0-b6ba-39d52121d0e7 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:43.140227 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6fe13-268c-48f4-a021-71e6d52300bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:43.141886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6fe13-268c-48f4-a021-71e6d52300bd None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:43.142442 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6fe13-268c-48f4-a021-71e6d52300bd None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:43.142949 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6fe13-268c-48f4-a021-71e6d52300bd None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:43.144528 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6fe13-268c-48f4-a021-71e6d52300bd None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:43.146204 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6fe13-268c-48f4-a021-71e6d52300bd None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:43.148704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 67/123] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:42 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:43.149233 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bec030-8719-4f0b-9fcb-d4df4a41045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:43.149922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6fe13-268c-48f4-a021-71e6d52300bd None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:43.150122 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bec030-8719-4f0b-9fcb-d4df4a41045e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:43.150205 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bec030-8719-4f0b-9fcb-d4df4a41045e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:43.150495 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bec030-8719-4f0b-9fcb-d4df4a41045e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:43.164302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:43.169612 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bec030-8719-4f0b-9fcb-d4df4a41045e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-f2bec030-8719-4f0b-9fcb-d4df4a41045e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:43.176432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:43.177360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:43.178164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 57/124] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:51:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:43.178867 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bec030-8719-4f0b-9fcb-d4df4a41045e None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:43.268383 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6fe13-268c-48f4-a021-71e6d52300bd None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:43.310227 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8332d89-58f0-4a03-9284-29c7f2bc5ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:43.311432 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332d89-58f0-4a03-9284-29c7f2bc5ca4 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:43.311966 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332d89-58f0-4a03-9284-29c7f2bc5ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:43.312435 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332d89-58f0-4a03-9284-29c7f2bc5ca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:43.314747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bec030-8719-4f0b-9fcb-d4df4a41045e None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:43.353348 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6830685-59f2-42b0-a662-6cdf30bae9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:43.354422 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6830685-59f2-42b0-a662-6cdf30bae9e8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:43.354937 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6830685-59f2-42b0-a662-6cdf30bae9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:43.355418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6830685-59f2-42b0-a662-6cdf30bae9e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:43.361316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:43.369341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6830685-59f2-42b0-a662-6cdf30bae9e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-a6830685-59f2-42b0-a662-6cdf30bae9e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:43.375446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:43.376835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:43.377821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:43.379308 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 58/125] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:43.380157 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6830685-59f2-42b0-a662-6cdf30bae9e8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:43.406237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8332d89-58f0-4a03-9284-29c7f2bc5ca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:43.408635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8332d89-58f0-4a03-9284-29c7f2bc5ca4 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:43.420492 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:43.501939 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6830685-59f2-42b0-a662-6cdf30bae9e8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:43.539202 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 68/126] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:43.543595 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8332d89-58f0-4a03-9284-29c7f2bc5ca4 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:43.546283 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abd846-da2e-41e4-a807-c4adc24e93f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:43.546553 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd846-da2e-41e4-a807-c4adc24e93f7 None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:43.546851 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd846-da2e-41e4-a807-c4adc24e93f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:43.547132 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd846-da2e-41e4-a807-c4adc24e93f7 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592/users/1c437a71edd54d15a20aca35e290b469/roles/d6d0c56d1054455c813546a2c761a7d0` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:43.549831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abd846-da2e-41e4-a807-c4adc24e93f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a43597721514990bc6b893382806592, user_id=1c437a71edd54d15a20aca35e290b469, role_id=d6d0c56d1054455c813546a2c761a7d0)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:43.551333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abd846-da2e-41e4-a807-c4adc24e93f7 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:43.569851 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 59/127] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:51:43 2022] PUT /identity/v3/projects/4a43597721514990bc6b893382806592/users/1c437a71edd54d15a20aca35e290b469/roles/d6d0c56d1054455c813546a2c761a7d0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:51:43.571106 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abd846-da2e-41e4-a807-c4adc24e93f7 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:43.683153 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:43.745641 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8332d89-58f0-4a03-9284-29c7f2bc5ca4 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:43.775137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:43.798083 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abd846-da2e-41e4-a807-c4adc24e93f7 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:43.830003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75f21c-602a-456c-9c7a-1674a845bea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:43.830677 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75f21c-602a-456c-9c7a-1674a845bea8 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:43.830961 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75f21c-602a-456c-9c7a-1674a845bea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:43.831240 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75f21c-602a-456c-9c7a-1674a845bea8 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:43.834683 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75f21c-602a-456c-9c7a-1674a845bea8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:43.834956 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75f21c-602a-456c-9c7a-1674a845bea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:43.837567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75f21c-602a-456c-9c7a-1674a845bea8 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:43.853719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 69/128] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:51:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:43.855224 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75f21c-602a-456c-9c7a-1674a845bea8 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:43.862671 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bdd58-ee00-46b9-a62b-5fecbd5cc9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:43.866934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bdd58-ee00-46b9-a62b-5fecbd5cc9a2 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:43.867287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bdd58-ee00-46b9-a62b-5fecbd5cc9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:43.867642 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bdd58-ee00-46b9-a62b-5fecbd5cc9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:43.868445 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bdd58-ee00-46b9-a62b-5fecbd5cc9a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:43.868827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bdd58-ee00-46b9-a62b-5fecbd5cc9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:43.870356 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bdd58-ee00-46b9-a62b-5fecbd5cc9a2 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:43.882994 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 60/129] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:51:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:43.883804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bdd58-ee00-46b9-a62b-5fecbd5cc9a2 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:44.132502 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75f21c-602a-456c-9c7a-1674a845bea8 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:44.196684 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bdd58-ee00-46b9-a62b-5fecbd5cc9a2 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:44.217087 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:44.270237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a08b39-a168-4cab-b9bb-2ed72814c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:44.271056 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08b39-a168-4cab-b9bb-2ed72814c621 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:44.271353 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08b39-a168-4cab-b9bb-2ed72814c621 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:44.271643 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08b39-a168-4cab-b9bb-2ed72814c621 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:44.275298 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a08b39-a168-4cab-b9bb-2ed72814c621 None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:44.276882 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a08b39-a168-4cab-b9bb-2ed72814c621 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:44.278482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8060aa4-f69a-4837-a159-1a019bf69fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:44.279189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8060aa4-f69a-4837-a159-1a019bf69fb1 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:44.279481 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8060aa4-f69a-4837-a159-1a019bf69fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:44.279769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8060aa4-f69a-4837-a159-1a019bf69fb1 None admin] PATH_INFO: `/v3/users/16e1cb5a7f654af08a1dedd2f065c65d` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:44.287156 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8060aa4-f69a-4837-a159-1a019bf69fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=16e1cb5a7f654af08a1dedd2f065c65d)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:44.287297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 70/130] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:43 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:44.288082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a08b39-a168-4cab-b9bb-2ed72814c621 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:44.288662 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8060aa4-f69a-4837-a159-1a019bf69fb1 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:44.290347 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 61/131] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:43 2022] GET /identity/v3/users/16e1cb5a7f654af08a1dedd2f065c65d => generated 275 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:44.302533 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8060aa4-f69a-4837-a159-1a019bf69fb1 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:44.389772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:44.462481 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a08b39-a168-4cab-b9bb-2ed72814c621 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:44.465008 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8060aa4-f69a-4837-a159-1a019bf69fb1 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:44.501163 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da825e80-0450-4f0b-8690-dd96f52b78ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:44.501827 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da825e80-0450-4f0b-8690-dd96f52b78ba None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:44.501932 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab316ac8-66ca-47e3-9e47-e419efc31630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:44.502135 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da825e80-0450-4f0b-8690-dd96f52b78ba None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:44.502392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da825e80-0450-4f0b-8690-dd96f52b78ba None admin] PATH_INFO: `/v3/users/16e1cb5a7f654af08a1dedd2f065c65d` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:44.502571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab316ac8-66ca-47e3-9e47-e419efc31630 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:44.502998 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab316ac8-66ca-47e3-9e47-e419efc31630 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:44.503143 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab316ac8-66ca-47e3-9e47-e419efc31630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:44.503619 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da825e80-0450-4f0b-8690-dd96f52b78ba None admin] RBAC: Authorizing `identity:get_user(user_id=16e1cb5a7f654af08a1dedd2f065c65d)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:44.503908 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab316ac8-66ca-47e3-9e47-e419efc31630 None admin] RBAC: Adding query filter params (role.id=1b3ca57e3e474fc79fac8dc29aedc036, scope.project.id=4a43597721514990bc6b893382806592, user.id=2a1eb1b33be547eb8d4d39a874447186) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:44.504222 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab316ac8-66ca-47e3-9e47-e419efc31630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:44.505095 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da825e80-0450-4f0b-8690-dd96f52b78ba None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:44.505672 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab316ac8-66ca-47e3-9e47-e419efc31630 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:44.506739 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 71/132] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:44 2022] GET /identity/v3/users/16e1cb5a7f654af08a1dedd2f065c65d => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:44.507507 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da825e80-0450-4f0b-8690-dd96f52b78ba None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:44.512655 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 62/133] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:44 2022] GET /identity/v3/role_assignments?user.id=2a1eb1b33be547eb8d4d39a874447186&scope.project.id=4a43597721514990bc6b893382806592&role.id=1b3ca57e3e474fc79fac8dc29aedc036 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:44.513943 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cb979-3160-441c-a784-3f6028862239 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:44.514239 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cb979-3160-441c-a784-3f6028862239 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:44.514545 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cb979-3160-441c-a784-3f6028862239 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:44.519910 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 63/134] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:44.520790 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cb979-3160-441c-a784-3f6028862239 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:44.580387 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:44.637688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cb979-3160-441c-a784-3f6028862239 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:44.675495 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498aa3-9923-4694-9127-6a3b6c89c100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:44.676198 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498aa3-9923-4694-9127-6a3b6c89c100 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:44.676559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498aa3-9923-4694-9127-6a3b6c89c100 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:44.676912 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498aa3-9923-4694-9127-6a3b6c89c100 None admin] PATH_INFO: `/v3/projects/366b886b290347488f3c24b82c1ff387` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:44.678309 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0498aa3-9923-4694-9127-6a3b6c89c100 None admin] RBAC: Authorizing `identity:get_project(project_id=366b886b290347488f3c24b82c1ff387)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:44.679906 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0498aa3-9923-4694-9127-6a3b6c89c100 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:44.682167 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 64/135] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:44 2022] GET /identity/v3/projects/366b886b290347488f3c24b82c1ff387 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:44.683470 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fc763-cbab-48c7-8da6-bc5b79d402f6 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:44.683835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fc763-cbab-48c7-8da6-bc5b79d402f6 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:44.684187 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fc763-cbab-48c7-8da6-bc5b79d402f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:44.704341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-797fc763-cbab-48c7-8da6-bc5b79d402f6 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:44.705761 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-797fc763-cbab-48c7-8da6-bc5b79d402f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:44.716764 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da825e80-0450-4f0b-8690-dd96f52b78ba None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:44.737564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:44.810843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 65/136] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:44.811502 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fc763-cbab-48c7-8da6-bc5b79d402f6 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:44.812995 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44104be-e186-402a-a1c6-5c22b27567a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:44.813713 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44104be-e186-402a-a1c6-5c22b27567a5 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:44.814002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44104be-e186-402a-a1c6-5c22b27567a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:44.814285 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44104be-e186-402a-a1c6-5c22b27567a5 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:44.815535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44104be-e186-402a-a1c6-5c22b27567a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:44.817010 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44104be-e186-402a-a1c6-5c22b27567a5 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:44.818707 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 72/137] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:44 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:44.828086 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44104be-e186-402a-a1c6-5c22b27567a5 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:44.894144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:44.963282 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44104be-e186-402a-a1c6-5c22b27567a5 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:45.017470 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fc763-cbab-48c7-8da6-bc5b79d402f6 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:45.020770 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d38177-671a-41df-b9b7-3f9891d386ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:45.023711 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38177-671a-41df-b9b7-3f9891d386ec None admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:45.024769 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38177-671a-41df-b9b7-3f9891d386ec None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:45.024769 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38177-671a-41df-b9b7-3f9891d386ec None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592/users/16e1cb5a7f654af08a1dedd2f065c65d/roles/4ff7ba49d92f490cba2d9ef2f9a36e79` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:45.031653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d38177-671a-41df-b9b7-3f9891d386ec None admin] RBAC: Authorizing `identity:create_grant(project_id=4a43597721514990bc6b893382806592, user_id=16e1cb5a7f654af08a1dedd2f065c65d, role_id=4ff7ba49d92f490cba2d9ef2f9a36e79)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:45.033939 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d38177-671a-41df-b9b7-3f9891d386ec None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:45.057930 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 73/138] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:51:44 2022] PUT /identity/v3/projects/4a43597721514990bc6b893382806592/users/16e1cb5a7f654af08a1dedd2f065c65d/roles/4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:51:45.059565 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d38177-671a-41df-b9b7-3f9891d386ec None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:45.080384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d865a13-4fa0-4281-9074-03e943d8d257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:45.081533 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d865a13-4fa0-4281-9074-03e943d8d257 None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:45.081836 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d865a13-4fa0-4281-9074-03e943d8d257 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:45.082128 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d865a13-4fa0-4281-9074-03e943d8d257 None admin] PATH_INFO: `/v3/projects/366b886b290347488f3c24b82c1ff387/users/16e1cb5a7f654af08a1dedd2f065c65d/roles/a2eb0e476c1f497888d73bb1d1771d16` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:45.087976 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d865a13-4fa0-4281-9074-03e943d8d257 None admin] RBAC: Authorizing `identity:create_grant(project_id=366b886b290347488f3c24b82c1ff387, user_id=16e1cb5a7f654af08a1dedd2f065c65d, role_id=a2eb0e476c1f497888d73bb1d1771d16)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:45.093075 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d865a13-4fa0-4281-9074-03e943d8d257 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:45.119558 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 66/139] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:51:44 2022] PUT /identity/v3/projects/366b886b290347488f3c24b82c1ff387/users/16e1cb5a7f654af08a1dedd2f065c65d/roles/a2eb0e476c1f497888d73bb1d1771d16 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:51:45.135453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:45.177175 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59751230-c4e4-439a-8dd0-2d47aacf76ea None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:45.177502 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59751230-c4e4-439a-8dd0-2d47aacf76ea None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:45.177761 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59751230-c4e4-439a-8dd0-2d47aacf76ea None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:45.179269 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 67/140] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:51:45.189091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31df84-e99a-4396-94e0-4ba7af66a575 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:45.189449 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31df84-e99a-4396-94e0-4ba7af66a575 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:45.189723 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31df84-e99a-4396-94e0-4ba7af66a575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:45.224662 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-1b31df84-e99a-4396-94e0-4ba7af66a575 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:45.228760 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-1b31df84-e99a-4396-94e0-4ba7af66a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:45.290893 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d38177-671a-41df-b9b7-3f9891d386ec None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:45.373643 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 68/141] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:45.383350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5bba1-e3e3-41b4-8494-e6f53fa204e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:45.383608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5bba1-e3e3-41b4-8494-e6f53fa204e7 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:45.384102 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5bba1-e3e3-41b4-8494-e6f53fa204e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:45.384567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5bba1-e3e3-41b4-8494-e6f53fa204e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:45.399629 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5bba1-e3e3-41b4-8494-e6f53fa204e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:45.405154 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31df84-e99a-4396-94e0-4ba7af66a575 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-7ee5bba1-e3e3-41b4-8494-e6f53fa204e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:45.405933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:45.407007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:45.408261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:45.410817 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 74/142] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:45.416914 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5bba1-e3e3-41b4-8494-e6f53fa204e7 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:45.459312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:45.544760 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31df84-e99a-4396-94e0-4ba7af66a575 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:45.586896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:45.596892 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5bba1-e3e3-41b4-8494-e6f53fa204e7 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:45.599259 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b182fe-bc6b-425b-a8e7-2e8634ca1fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:45.599935 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b182fe-bc6b-425b-a8e7-2e8634ca1fdf None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:45.600225 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b182fe-bc6b-425b-a8e7-2e8634ca1fdf None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:45.600505 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b182fe-bc6b-425b-a8e7-2e8634ca1fdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:45.601720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b182fe-bc6b-425b-a8e7-2e8634ca1fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:45.603300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b182fe-bc6b-425b-a8e7-2e8634ca1fdf None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:45.604914 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 69/143] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:45.615690 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b182fe-bc6b-425b-a8e7-2e8634ca1fdf None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:45.668537 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20525662-d264-4fe4-a1f0-390f67f0ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:45.669184 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20525662-d264-4fe4-a1f0-390f67f0ba0f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:45.669471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20525662-d264-4fe4-a1f0-390f67f0ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:45.669755 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20525662-d264-4fe4-a1f0-390f67f0ba0f None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:45.670638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20525662-d264-4fe4-a1f0-390f67f0ba0f None admin] RBAC: Adding query filter params (name=member) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:45.670955 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20525662-d264-4fe4-a1f0-390f67f0ba0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:45.673092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20525662-d264-4fe4-a1f0-390f67f0ba0f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:45.693752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 75/144] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:51:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:45.699840 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20525662-d264-4fe4-a1f0-390f67f0ba0f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:45.779524 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b182fe-bc6b-425b-a8e7-2e8634ca1fdf None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:45.798895 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:45.839236 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d98cb6-d9e4-4fe3-a64d-abade0cb470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:45.839884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d98cb6-d9e4-4fe3-a64d-abade0cb470d None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:45.840173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d98cb6-d9e4-4fe3-a64d-abade0cb470d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:45.840451 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d98cb6-d9e4-4fe3-a64d-abade0cb470d None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:45.841145 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d98cb6-d9e4-4fe3-a64d-abade0cb470d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:45.842686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d98cb6-d9e4-4fe3-a64d-abade0cb470d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:45.877919 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 70/145] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:51:45 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 17:51:45.940999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20525662-d264-4fe4-a1f0-390f67f0ba0f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:45.995249 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd5df5-080b-4481-b580-a0d973c725e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:45.995908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd5df5-080b-4481-b580-a0d973c725e4 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:45.996192 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd5df5-080b-4481-b580-a0d973c725e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:45.996471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd5df5-080b-4481-b580-a0d973c725e4 None admin] PATH_INFO: `/v3/users/16e1cb5a7f654af08a1dedd2f065c65d` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:45.997666 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd5df5-080b-4481-b580-a0d973c725e4 None admin] RBAC: Authorizing `identity:get_user(user_id=16e1cb5a7f654af08a1dedd2f065c65d)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:45.999149 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd5df5-080b-4481-b580-a0d973c725e4 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:46.000865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 76/146] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:45 2022] GET /identity/v3/users/16e1cb5a7f654af08a1dedd2f065c65d => generated 275 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:46.007354 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d98cb6-d9e4-4fe3-a64d-abade0cb470d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:46.148643 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d98cb6-d9e4-4fe3-a64d-abade0cb470d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:46.189240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b4eec-1a85-497d-847b-eca7ce3230e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:46.190255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b4eec-1a85-497d-847b-eca7ce3230e5 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:46.190793 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b4eec-1a85-497d-847b-eca7ce3230e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:46.191276 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b4eec-1a85-497d-847b-eca7ce3230e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:46.227360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:46.279526 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b4eec-1a85-497d-847b-eca7ce3230e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:46.281045 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b4eec-1a85-497d-847b-eca7ce3230e5 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:46.404540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 71/147] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:46.411345 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd5df5-080b-4481-b580-a0d973c725e4 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:46.442715 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:46.541610 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd5df5-080b-4481-b580-a0d973c725e4 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:46.587137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbd53f-b8fe-422a-adbc-547fed8aaf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:46.588676 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbd53f-b8fe-422a-adbc-547fed8aaf8f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:46.589163 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbd53f-b8fe-422a-adbc-547fed8aaf8f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:46.589673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbd53f-b8fe-422a-adbc-547fed8aaf8f None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:46.591211 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbd53f-b8fe-422a-adbc-547fed8aaf8f None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:46.592879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbd53f-b8fe-422a-adbc-547fed8aaf8f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:46.598438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 77/148] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:46 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:46.607689 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b4eec-1a85-497d-847b-eca7ce3230e5 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:46.698615 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:46.731018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0efaa-ca14-4e62-af93-501c449be82a None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:46.731351 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0efaa-ca14-4e62-af93-501c449be82a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:46.731595 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0efaa-ca14-4e62-af93-501c449be82a None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:46.733209 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 78/149] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:46.740867 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebce55-252c-4718-a809-c19603009f5a None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:46.741162 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebce55-252c-4718-a809-c19603009f5a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:46.741447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebce55-252c-4718-a809-c19603009f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:46.748382 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b4eec-1a85-497d-847b-eca7ce3230e5 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:46.776086 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-f9ebce55-252c-4718-a809-c19603009f5a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:46.777665 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-f9ebce55-252c-4718-a809-c19603009f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:46.804003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf503e4-bba4-42ba-9006-c141bc6e3879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:46.804867 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf503e4-bba4-42ba-9006-c141bc6e3879 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:46.805297 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf503e4-bba4-42ba-9006-c141bc6e3879 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:46.805707 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf503e4-bba4-42ba-9006-c141bc6e3879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:46.806706 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf503e4-bba4-42ba-9006-c141bc6e3879 None admin] RBAC: Adding query filter params (role.id=a2eb0e476c1f497888d73bb1d1771d16, scope.project.id=4a43597721514990bc6b893382806592, user.id=16e1cb5a7f654af08a1dedd2f065c65d) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:46.807173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf503e4-bba4-42ba-9006-c141bc6e3879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:46.808764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf503e4-bba4-42ba-9006-c141bc6e3879 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:46.816381 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 72/150] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:46 2022] GET /identity/v3/role_assignments?user.id=16e1cb5a7f654af08a1dedd2f065c65d&scope.project.id=4a43597721514990bc6b893382806592&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:46.903502 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 79/151] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:46.944295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf503e4-bba4-42ba-9006-c141bc6e3879 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:47.102367 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf503e4-bba4-42ba-9006-c141bc6e3879 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:47.136794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:47.146683 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d55ab-e630-4e21-8e42-a8d96de41306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:47.147347 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d55ab-e630-4e21-8e42-a8d96de41306 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:47.147628 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d55ab-e630-4e21-8e42-a8d96de41306 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:47.148163 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d55ab-e630-4e21-8e42-a8d96de41306 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:47.168297 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d55ab-e630-4e21-8e42-a8d96de41306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-d30d55ab-e630-4e21-8e42-a8d96de41306 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:47.174012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:47.174909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:47.176114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 73/152] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:51:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:47.181177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebce55-252c-4718-a809-c19603009f5a None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:47.222996 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:47.302101 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebce55-252c-4718-a809-c19603009f5a None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:47.340798 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97387549-c605-4804-b177-aba664238000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:47.341667 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387549-c605-4804-b177-aba664238000 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:47.342113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387549-c605-4804-b177-aba664238000 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:47.342572 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387549-c605-4804-b177-aba664238000 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:47.343453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97387549-c605-4804-b177-aba664238000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:47.343909 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97387549-c605-4804-b177-aba664238000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:47.346200 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97387549-c605-4804-b177-aba664238000 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:47.357476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 80/153] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:47.364254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d55ab-e630-4e21-8e42-a8d96de41306 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:47.496695 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d55ab-e630-4e21-8e42-a8d96de41306 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:47.532570 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed7d80-ce5c-4915-88f0-39c294a28e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:47.533340 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed7d80-ce5c-4915-88f0-39c294a28e4a None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:47.533666 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed7d80-ce5c-4915-88f0-39c294a28e4a None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:47.533949 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed7d80-ce5c-4915-88f0-39c294a28e4a None admin] PATH_INFO: `/v3/users/1c437a71edd54d15a20aca35e290b469` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:47.535152 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed7d80-ce5c-4915-88f0-39c294a28e4a None admin] RBAC: Authorizing `identity:get_user(user_id=1c437a71edd54d15a20aca35e290b469)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:47.536596 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed7d80-ce5c-4915-88f0-39c294a28e4a None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:47.538502 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 74/154] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:47 2022] GET /identity/v3/users/1c437a71edd54d15a20aca35e290b469 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:47.544058 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97387549-c605-4804-b177-aba664238000 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:47.647655 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:47.667636 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97387549-c605-4804-b177-aba664238000 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:47.725177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea5309-72e0-4250-9a03-cb8b05ed49d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:47.725802 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea5309-72e0-4250-9a03-cb8b05ed49d8 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:47.726084 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea5309-72e0-4250-9a03-cb8b05ed49d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:47.726359 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea5309-72e0-4250-9a03-cb8b05ed49d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:47.834230 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea5309-72e0-4250-9a03-cb8b05ed49d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:47.835730 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea5309-72e0-4250-9a03-cb8b05ed49d8 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:47.951108 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:47.979455 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 81/155] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:47.985373 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed7d80-ce5c-4915-88f0-39c294a28e4a None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:48.070848 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:48.139179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed7d80-ce5c-4915-88f0-39c294a28e4a None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:48.186546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919c35a-120b-4a3f-84d1-ea375bc382e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:48.187233 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919c35a-120b-4a3f-84d1-ea375bc382e5 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:48.187523 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919c35a-120b-4a3f-84d1-ea375bc382e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:48.187807 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919c35a-120b-4a3f-84d1-ea375bc382e5 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:48.189431 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919c35a-120b-4a3f-84d1-ea375bc382e5 None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:48.190991 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919c35a-120b-4a3f-84d1-ea375bc382e5 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:48.193236 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 75/156] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:47 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:48.198941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea5309-72e0-4250-9a03-cb8b05ed49d8 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:48.341692 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61222769-0145-4614-a138-196f7ff59f84 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:48.342043 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61222769-0145-4614-a138-196f7ff59f84 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:48.342263 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61222769-0145-4614-a138-196f7ff59f84 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:48.343659 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 76/157] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:51:48.362388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea5309-72e0-4250-9a03-cb8b05ed49d8 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:48.374255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2335a-0b74-42e2-9fbd-f5c62a2b3729 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:48.374592 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2335a-0b74-42e2-9fbd-f5c62a2b3729 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:48.374835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2335a-0b74-42e2-9fbd-f5c62a2b3729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:48.411575 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-d7f2335a-0b74-42e2-9fbd-f5c62a2b3729 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:48.412980 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-d7f2335a-0b74-42e2-9fbd-f5c62a2b3729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:48.424295 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2675e4-896d-4109-9e62-df92d08c1fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:48.425484 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2675e4-896d-4109-9e62-df92d08c1fff None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:48.425977 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2675e4-896d-4109-9e62-df92d08c1fff None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:48.426462 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2675e4-896d-4109-9e62-df92d08c1fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:48.427496 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2675e4-896d-4109-9e62-df92d08c1fff None admin] RBAC: Adding query filter params (role.id=d6d0c56d1054455c813546a2c761a7d0, scope.project.id=4a43597721514990bc6b893382806592, user.id=1c437a71edd54d15a20aca35e290b469) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:48.428017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2675e4-896d-4109-9e62-df92d08c1fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:48.429656 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2675e4-896d-4109-9e62-df92d08c1fff None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:48.442135 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 82/158] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:48 2022] GET /identity/v3/role_assignments?user.id=1c437a71edd54d15a20aca35e290b469&scope.project.id=4a43597721514990bc6b893382806592&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:48.443787 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476264-4054-430c-9347-0f5276ca57b1 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:48.444392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476264-4054-430c-9347-0f5276ca57b1 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:48.444887 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476264-4054-430c-9347-0f5276ca57b1 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:48.446675 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 83/159] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:48.451982 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103cdf7-59fe-4e5d-936e-f6f038a086c7 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:48.452585 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103cdf7-59fe-4e5d-936e-f6f038a086c7 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:48.453061 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103cdf7-59fe-4e5d-936e-f6f038a086c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:48.484141 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-b103cdf7-59fe-4e5d-936e-f6f038a086c7 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:48.486570 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-b103cdf7-59fe-4e5d-936e-f6f038a086c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:48.545984 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 77/160] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:48.582728 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:48.612944 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2335a-0b74-42e2-9fbd-f5c62a2b3729 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:48.616530 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 84/161] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:48.664331 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103cdf7-59fe-4e5d-936e-f6f038a086c7 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:48.690117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:48.836041 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2335a-0b74-42e2-9fbd-f5c62a2b3729 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:48.902772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103cdf7-59fe-4e5d-936e-f6f038a086c7 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:48.929063 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c178cc1-6567-460f-bf32-5d699a7eec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:48.929748 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c178cc1-6567-460f-bf32-5d699a7eec93 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:48.930034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c178cc1-6567-460f-bf32-5d699a7eec93 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:48.930310 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c178cc1-6567-460f-bf32-5d699a7eec93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:48.958013 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c178cc1-6567-460f-bf32-5d699a7eec93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-2c178cc1-6567-460f-bf32-5d699a7eec93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:48.963212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:48.964096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:48.964930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 78/162] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:48.980898 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7a9ef-9ff0-4a94-8127-ca99f455cb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:48.981565 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7a9ef-9ff0-4a94-8127-ca99f455cb4b None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:48.981851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7a9ef-9ff0-4a94-8127-ca99f455cb4b None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:48.982136 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7a9ef-9ff0-4a94-8127-ca99f455cb4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:48.993239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7a9ef-9ff0-4a94-8127-ca99f455cb4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:48.997014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c178cc1-6567-460f-bf32-5d699a7eec93 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-11c7a9ef-9ff0-4a94-8127-ca99f455cb4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:49.011441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:49.012431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:49.014825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 85/163] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:51:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:51:49.019535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7a9ef-9ff0-4a94-8127-ca99f455cb4b None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:49.080057 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:49.159171 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c178cc1-6567-460f-bf32-5d699a7eec93 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:49.182165 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:49.196707 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7a9ef-9ff0-4a94-8127-ca99f455cb4b None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:49.228800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c2c82-5fc5-4fe2-bf87-2bd1ef79c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:49.229792 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c2c82-5fc5-4fe2-bf87-2bd1ef79c011 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:49.230279 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c2c82-5fc5-4fe2-bf87-2bd1ef79c011 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:49.230820 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c2c82-5fc5-4fe2-bf87-2bd1ef79c011 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:49.231750 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c2c82-5fc5-4fe2-bf87-2bd1ef79c011 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:49.232257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c2c82-5fc5-4fe2-bf87-2bd1ef79c011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:49.234043 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c2c82-5fc5-4fe2-bf87-2bd1ef79c011 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:49.250648 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 79/164] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:51:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:49.252642 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532169f-b8f6-42ff-a288-f6846fe04dd7 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:49.254367 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532169f-b8f6-42ff-a288-f6846fe04dd7 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:49.255967 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532169f-b8f6-42ff-a288-f6846fe04dd7 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:49.258142 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 80/165] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:49.259151 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532169f-b8f6-42ff-a288-f6846fe04dd7 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:49.265808 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11df71c-7697-4f41-81f6-81fe877867df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:49.267452 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11df71c-7697-4f41-81f6-81fe877867df None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:49.267942 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11df71c-7697-4f41-81f6-81fe877867df None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:49.268437 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11df71c-7697-4f41-81f6-81fe877867df None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:49.269363 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11df71c-7697-4f41-81f6-81fe877867df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:49.270664 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11df71c-7697-4f41-81f6-81fe877867df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:49.272265 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11df71c-7697-4f41-81f6-81fe877867df None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:49.290233 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 86/166] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:51:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:49.293349 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c0bd-5bbb-45c3-8bd1-096cba386215 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:49.294836 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c0bd-5bbb-45c3-8bd1-096cba386215 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:49.295336 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c0bd-5bbb-45c3-8bd1-096cba386215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:49.322435 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-8565c0bd-5bbb-45c3-8bd1-096cba386215 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:49.324006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-8565c0bd-5bbb-45c3-8bd1-096cba386215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:49.449193 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 87/167] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:49.450705 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c0bd-5bbb-45c3-8bd1-096cba386215 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:49.466271 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532169f-b8f6-42ff-a288-f6846fe04dd7 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:49.510903 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:49.541764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13225b0-56be-4fd3-8b81-7b813e043229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:49.543699 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13225b0-56be-4fd3-8b81-7b813e043229 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:49.545686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13225b0-56be-4fd3-8b81-7b813e043229 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:49.546179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13225b0-56be-4fd3-8b81-7b813e043229 None admin] PATH_INFO: `/v3/users/2a1eb1b33be547eb8d4d39a874447186` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:49.550181 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13225b0-56be-4fd3-8b81-7b813e043229 None admin] RBAC: Authorizing `identity:get_user(user_id=2a1eb1b33be547eb8d4d39a874447186)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:49.551926 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13225b0-56be-4fd3-8b81-7b813e043229 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:49.555012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 81/168] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:49 2022] GET /identity/v3/users/2a1eb1b33be547eb8d4d39a874447186 => generated 289 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:49.559623 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13225b0-56be-4fd3-8b81-7b813e043229 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:49.617314 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c0bd-5bbb-45c3-8bd1-096cba386215 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:49.651123 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:49.661044 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f199f3-f10b-4902-a807-610681fc1584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:49.662025 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f199f3-f10b-4902-a807-610681fc1584 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:49.662560 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f199f3-f10b-4902-a807-610681fc1584 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:49.663046 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f199f3-f10b-4902-a807-610681fc1584 None admin] PATH_INFO: `/v3/users/16e1cb5a7f654af08a1dedd2f065c65d` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:49.664453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f199f3-f10b-4902-a807-610681fc1584 None admin] RBAC: Authorizing `identity:get_user(user_id=16e1cb5a7f654af08a1dedd2f065c65d)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:49.666600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f199f3-f10b-4902-a807-610681fc1584 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:49.668824 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 88/169] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:49 2022] GET /identity/v3/users/16e1cb5a7f654af08a1dedd2f065c65d => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:49.670328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f199f3-f10b-4902-a807-610681fc1584 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:49.783378 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:49.787075 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f199f3-f10b-4902-a807-610681fc1584 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:49.811803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13225b0-56be-4fd3-8b81-7b813e043229 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:49.825791 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ca522-59bf-4d97-92c3-256fb48067fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:49.826838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ca522-59bf-4d97-92c3-256fb48067fc None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:49.827338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ca522-59bf-4d97-92c3-256fb48067fc None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:49.827815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ca522-59bf-4d97-92c3-256fb48067fc None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:49.829368 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ca522-59bf-4d97-92c3-256fb48067fc None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:49.831185 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ca522-59bf-4d97-92c3-256fb48067fc None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:49.833257 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 89/170] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:49 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:49.834546 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ca522-59bf-4d97-92c3-256fb48067fc None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:49.870542 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea24b5-694a-4365-a567-2e1844270923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:49.870542 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea24b5-694a-4365-a567-2e1844270923 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:49.870542 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea24b5-694a-4365-a567-2e1844270923 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:49.870542 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea24b5-694a-4365-a567-2e1844270923 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:49.892361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea24b5-694a-4365-a567-2e1844270923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-20ea24b5-694a-4365-a567-2e1844270923 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:49.908294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:49.910019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 82/171] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:49.910831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea24b5-694a-4365-a567-2e1844270923 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:50.050188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ca522-59bf-4d97-92c3-256fb48067fc None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:50.087819 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea24b5-694a-4365-a567-2e1844270923 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:50.090044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:50.133097 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998206d3-fb63-4d54-b3c0-247300e1c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:50.133810 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998206d3-fb63-4d54-b3c0-247300e1c1e9 None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:50.134105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998206d3-fb63-4d54-b3c0-247300e1c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:50.134392 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998206d3-fb63-4d54-b3c0-247300e1c1e9 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592/users/2a1eb1b33be547eb8d4d39a874447186/roles/1b3ca57e3e474fc79fac8dc29aedc036` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:50.136844 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb2ec1-0b7a-4cd5-a3f4-31a691e12caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:50.137499 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2ec1-0b7a-4cd5-a3f4-31a691e12caa None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:50.137839 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2ec1-0b7a-4cd5-a3f4-31a691e12caa None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:50.138121 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2ec1-0b7a-4cd5-a3f4-31a691e12caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:50.140077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998206d3-fb63-4d54-b3c0-247300e1c1e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a43597721514990bc6b893382806592, user_id=2a1eb1b33be547eb8d4d39a874447186, role_id=1b3ca57e3e474fc79fac8dc29aedc036)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:50.141940 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998206d3-fb63-4d54-b3c0-247300e1c1e9 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:50.168844 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 83/172] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:51:49 2022] PUT /identity/v3/projects/4a43597721514990bc6b893382806592/users/2a1eb1b33be547eb8d4d39a874447186/roles/1b3ca57e3e474fc79fac8dc29aedc036 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:51:50.170021 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998206d3-fb63-4d54-b3c0-247300e1c1e9 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:50.178854 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:50.217354 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb2ec1-0b7a-4cd5-a3f4-31a691e12caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:50.219264 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb2ec1-0b7a-4cd5-a3f4-31a691e12caa None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:50.319436 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998206d3-fb63-4d54-b3c0-247300e1c1e9 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:50.370543 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 90/173] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:50.372394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e326b3-5f8c-4f78-b3b6-5e00dcd72170 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:50.372898 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e326b3-5f8c-4f78-b3b6-5e00dcd72170 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:50.373398 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e326b3-5f8c-4f78-b3b6-5e00dcd72170 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:50.374996 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 91/174] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:50.383598 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e326b3-5f8c-4f78-b3b6-5e00dcd72170 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:50.392395 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896002-707f-4d18-8645-818e1ac72434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:50.393129 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896002-707f-4d18-8645-818e1ac72434 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:50.393412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896002-707f-4d18-8645-818e1ac72434 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:50.393749 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896002-707f-4d18-8645-818e1ac72434 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:50.396103 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67896002-707f-4d18-8645-818e1ac72434 None admin] RBAC: Adding query filter params (name=member) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:50.396416 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67896002-707f-4d18-8645-818e1ac72434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:50.397840 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67896002-707f-4d18-8645-818e1ac72434 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:50.421100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 84/175] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:51:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:50.429778 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77563f-cbe8-4d85-b06c-cf3d97b8b2a2 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:50.430103 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77563f-cbe8-4d85-b06c-cf3d97b8b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:50.430346 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77563f-cbe8-4d85-b06c-cf3d97b8b2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:50.463272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-5d77563f-cbe8-4d85-b06c-cf3d97b8b2a2 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:50.464476 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-5d77563f-cbe8-4d85-b06c-cf3d97b8b2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:50.495607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:50.503222 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:50.540693 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e326b3-5f8c-4f78-b3b6-5e00dcd72170 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:50.560050 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 85/176] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:50.561255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77563f-cbe8-4d85-b06c-cf3d97b8b2a2 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:50.592726 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85319026-d772-4d77-9769-edff775e741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:50.593411 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85319026-d772-4d77-9769-edff775e741e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:50.593692 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85319026-d772-4d77-9769-edff775e741e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:50.594045 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85319026-d772-4d77-9769-edff775e741e None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:50.599450 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85319026-d772-4d77-9769-edff775e741e None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:50.604036 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85319026-d772-4d77-9769-edff775e741e None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:50.607165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 92/177] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:50 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:50.608357 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85319026-d772-4d77-9769-edff775e741e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:50.720958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85319026-d772-4d77-9769-edff775e741e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:50.734543 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77563f-cbe8-4d85-b06c-cf3d97b8b2a2 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:50.769542 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1da41-51a7-4e5d-bf63-887f2195c773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:50.770203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1da41-51a7-4e5d-bf63-887f2195c773 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:50.770923 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1da41-51a7-4e5d-bf63-887f2195c773 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:50.770923 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1da41-51a7-4e5d-bf63-887f2195c773 None admin] PATH_INFO: `/v3/users/16e1cb5a7f654af08a1dedd2f065c65d` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:50.772003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1da41-51a7-4e5d-bf63-887f2195c773 None admin] RBAC: Authorizing `identity:get_user(user_id=16e1cb5a7f654af08a1dedd2f065c65d)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:50.773730 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1da41-51a7-4e5d-bf63-887f2195c773 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:50.775599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 86/178] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:50 2022] GET /identity/v3/users/16e1cb5a7f654af08a1dedd2f065c65d => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:50.776193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1da41-51a7-4e5d-bf63-887f2195c773 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:50.788140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c928f2f-53fe-4f8d-a8e4-8a2daaec9c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:50.789254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928f2f-53fe-4f8d-a8e4-8a2daaec9c93 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:50.789738 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928f2f-53fe-4f8d-a8e4-8a2daaec9c93 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:50.796202 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928f2f-53fe-4f8d-a8e4-8a2daaec9c93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:50.800269 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:50.804144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:50.812808 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c928f2f-53fe-4f8d-a8e4-8a2daaec9c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-9c928f2f-53fe-4f8d-a8e4-8a2daaec9c93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:50.818476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:50.819457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:50.820260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:50.822689 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 93/179] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:50.823991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c928f2f-53fe-4f8d-a8e4-8a2daaec9c93 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:50.888197 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1da41-51a7-4e5d-bf63-887f2195c773 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:50.925302 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c9f5e-fd33-4c81-b9ae-1f21932d4f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:50.925943 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9f5e-fd33-4c81-b9ae-1f21932d4f95 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:50.926234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9f5e-fd33-4c81-b9ae-1f21932d4f95 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:50.926540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9f5e-fd33-4c81-b9ae-1f21932d4f95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:50.927951 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c9f5e-fd33-4c81-b9ae-1f21932d4f95 None admin] RBAC: Adding query filter params (role.id=4ff7ba49d92f490cba2d9ef2f9a36e79, scope.project.id=4a43597721514990bc6b893382806592, user.id=16e1cb5a7f654af08a1dedd2f065c65d) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:50.928276 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c9f5e-fd33-4c81-b9ae-1f21932d4f95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:50.929807 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c9f5e-fd33-4c81-b9ae-1f21932d4f95 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:50.937425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 87/180] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:50 2022] GET /identity/v3/role_assignments?user.id=16e1cb5a7f654af08a1dedd2f065c65d&scope.project.id=4a43597721514990bc6b893382806592&role.id=4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:50.938907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c9f5e-fd33-4c81-b9ae-1f21932d4f95 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:50.988133 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c928f2f-53fe-4f8d-a8e4-8a2daaec9c93 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:51.035736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006efee0-c9e2-4369-a507-c7dfca000548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:51.036528 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006efee0-c9e2-4369-a507-c7dfca000548 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.036813 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006efee0-c9e2-4369-a507-c7dfca000548 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.037095 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006efee0-c9e2-4369-a507-c7dfca000548 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.078868 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:51.101661 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c9f5e-fd33-4c81-b9ae-1f21932d4f95 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:51.133538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:51.139551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006efee0-c9e2-4369-a507-c7dfca000548 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:51.141972 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006efee0-c9e2-4369-a507-c7dfca000548 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:51.158943 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb48dd3-14f5-45aa-9875-d55862057a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:51.160764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48dd3-14f5-45aa-9875-d55862057a66 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.161219 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48dd3-14f5-45aa-9875-d55862057a66 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.161629 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48dd3-14f5-45aa-9875-d55862057a66 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.162869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb48dd3-14f5-45aa-9875-d55862057a66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:51.163211 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb48dd3-14f5-45aa-9875-d55862057a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:51.164641 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb48dd3-14f5-45aa-9875-d55862057a66 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:51.176266 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 88/181] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:51.176266 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93037b-b9e5-4ee2-b5d3-a38f3f2ffeca None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.176604 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93037b-b9e5-4ee2-b5d3-a38f3f2ffeca None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.176846 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93037b-b9e5-4ee2-b5d3-a38f3f2ffeca None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.178188 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 89/182] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:51.179190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11434-2eb6-474a-aa1d-93f7deaf179a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.179470 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11434-2eb6-474a-aa1d-93f7deaf179a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.179785 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11434-2eb6-474a-aa1d-93f7deaf179a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.181119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 90/183] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:51.186475 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a4b3-b245-4ff7-8857-b055acc5b61d None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.186820 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a4b3-b245-4ff7-8857-b055acc5b61d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.187102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a4b3-b245-4ff7-8857-b055acc5b61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.210002 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-41e0a4b3-b245-4ff7-8857-b055acc5b61d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:51.211229 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-41e0a4b3-b245-4ff7-8857-b055acc5b61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:51.265209 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 94/184] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:51.266284 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006efee0-c9e2-4369-a507-c7dfca000548 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:51.291718 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 91/185] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:51.293063 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ce6a-f232-481b-b06c-9c385d4204af None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.293354 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ce6a-f232-481b-b06c-9c385d4204af None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.293629 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ce6a-f232-481b-b06c-9c385d4204af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.317988 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-d457ce6a-f232-481b-b06c-9c385d4204af None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:51.319371 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-d457ce6a-f232-481b-b06c-9c385d4204af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:51.371692 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:51.379702 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006efee0-c9e2-4369-a507-c7dfca000548 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:51.391162 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 92/186] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:51.392964 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457ce6a-f232-481b-b06c-9c385d4204af None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:51.409926 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:51.424984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad5999-5e5b-4e70-a588-65b6a547eba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:51.426113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5999-5e5b-4e70-a588-65b6a547eba8 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.426404 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5999-5e5b-4e70-a588-65b6a547eba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.426712 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5999-5e5b-4e70-a588-65b6a547eba8 None admin] PATH_INFO: `/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.440983 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad5999-5e5b-4e70-a588-65b6a547eba8 None admin] RBAC: Authorizing `identity:get_user(user_id=10aab926644f40b6b3e7c9c7c9fae4fa)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:51.442459 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad5999-5e5b-4e70-a588-65b6a547eba8 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:51.444375 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 95/187] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:51 2022] GET /identity/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:51.444933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad5999-5e5b-4e70-a588-65b6a547eba8 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:51.513324 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457ce6a-f232-481b-b06c-9c385d4204af None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:51.551739 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01183f1-d20b-41e6-aea3-0b5c3cc83991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:51.552394 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01183f1-d20b-41e6-aea3-0b5c3cc83991 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.552676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01183f1-d20b-41e6-aea3-0b5c3cc83991 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.552951 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01183f1-d20b-41e6-aea3-0b5c3cc83991 None admin] PATH_INFO: `/v3/projects/366b886b290347488f3c24b82c1ff387` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.554114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01183f1-d20b-41e6-aea3-0b5c3cc83991 None admin] RBAC: Authorizing `identity:get_project(project_id=366b886b290347488f3c24b82c1ff387)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:51.555598 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01183f1-d20b-41e6-aea3-0b5c3cc83991 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:51.557321 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 93/188] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:51 2022] GET /identity/v3/projects/366b886b290347488f3c24b82c1ff387 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:51.557817 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad5999-5e5b-4e70-a588-65b6a547eba8 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:51.558097 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01183f1-d20b-41e6-aea3-0b5c3cc83991 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:51.604992 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7783b7e-74fb-4e47-9495-2ffb3f7ee93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:51.605708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7783b7e-74fb-4e47-9495-2ffb3f7ee93c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.605989 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7783b7e-74fb-4e47-9495-2ffb3f7ee93c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.606265 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7783b7e-74fb-4e47-9495-2ffb3f7ee93c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.617840 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7783b7e-74fb-4e47-9495-2ffb3f7ee93c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-b7783b7e-74fb-4e47-9495-2ffb3f7ee93c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:51.622912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:51.623988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 96/189] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:51:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:51.630315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7783b7e-74fb-4e47-9495-2ffb3f7ee93c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:51.644109 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:51.665247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:51.692758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01183f1-d20b-41e6-aea3-0b5c3cc83991 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:51.732817 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba01612-4c80-4e8b-b3c5-e30abf7317d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:51.733465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01612-4c80-4e8b-b3c5-e30abf7317d7 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.733748 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01612-4c80-4e8b-b3c5-e30abf7317d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.734017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7783b7e-74fb-4e47-9495-2ffb3f7ee93c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:51.734458 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01612-4c80-4e8b-b3c5-e30abf7317d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.735876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba01612-4c80-4e8b-b3c5-e30abf7317d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:51.737726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba01612-4c80-4e8b-b3c5-e30abf7317d7 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:51.739129 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 94/190] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:51.739731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba01612-4c80-4e8b-b3c5-e30abf7317d7 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:51.778299 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450feaa3-83cd-4db8-be30-0a9512309bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:51.778966 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450feaa3-83cd-4db8-be30-0a9512309bfa None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.779236 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450feaa3-83cd-4db8-be30-0a9512309bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.779515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450feaa3-83cd-4db8-be30-0a9512309bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.853541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba01612-4c80-4e8b-b3c5-e30abf7317d7 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:51.854855 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450feaa3-83cd-4db8-be30-0a9512309bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:51.856412 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450feaa3-83cd-4db8-be30-0a9512309bfa None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:51.872925 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:51.891080 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba497be3-d8b8-44a3-9a9e-488fbd61fe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:51.891737 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497be3-d8b8-44a3-9a9e-488fbd61fe59 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:51.892119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497be3-d8b8-44a3-9a9e-488fbd61fe59 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:51.892294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497be3-d8b8-44a3-9a9e-488fbd61fe59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:51.893082 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba497be3-d8b8-44a3-9a9e-488fbd61fe59 None admin] RBAC: Adding query filter params (role.id=a2eb0e476c1f497888d73bb1d1771d16, scope.project.id=366b886b290347488f3c24b82c1ff387, user.id=16e1cb5a7f654af08a1dedd2f065c65d) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:51.893932 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba497be3-d8b8-44a3-9a9e-488fbd61fe59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:51.894940 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba497be3-d8b8-44a3-9a9e-488fbd61fe59 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:51.901355 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 95/191] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:51 2022] GET /identity/v3/role_assignments?user.id=16e1cb5a7f654af08a1dedd2f065c65d&scope.project.id=366b886b290347488f3c24b82c1ff387&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:51.902459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba497be3-d8b8-44a3-9a9e-488fbd61fe59 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:51.914854 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:52.002639 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 97/192] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:52.004005 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450feaa3-83cd-4db8-be30-0a9512309bfa None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:52.034608 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba497be3-d8b8-44a3-9a9e-488fbd61fe59 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:52.081495 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19974a3d-9e50-45be-93c6-8e3aae4876b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:52.083141 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19974a3d-9e50-45be-93c6-8e3aae4876b1 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:52.083606 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19974a3d-9e50-45be-93c6-8e3aae4876b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:52.084290 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19974a3d-9e50-45be-93c6-8e3aae4876b1 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:52.085468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19974a3d-9e50-45be-93c6-8e3aae4876b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:52.086003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19974a3d-9e50-45be-93c6-8e3aae4876b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:52.088260 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19974a3d-9e50-45be-93c6-8e3aae4876b1 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:52.099407 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 96/193] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:51:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:52.100672 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19974a3d-9e50-45be-93c6-8e3aae4876b1 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:52.137257 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450feaa3-83cd-4db8-be30-0a9512309bfa None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:52.153638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:52.178815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12710fc9-900a-4d9b-bff7-9e00ec9cf8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:52.179720 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710fc9-900a-4d9b-bff7-9e00ec9cf8fd None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:52.180159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710fc9-900a-4d9b-bff7-9e00ec9cf8fd None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:52.180593 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710fc9-900a-4d9b-bff7-9e00ec9cf8fd None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:52.181492 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12710fc9-900a-4d9b-bff7-9e00ec9cf8fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:52.182931 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:52.183372 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12710fc9-900a-4d9b-bff7-9e00ec9cf8fd None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:52.212246 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 98/194] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:51:52 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:52.212919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12710fc9-900a-4d9b-bff7-9e00ec9cf8fd None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:52.240856 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19974a3d-9e50-45be-93c6-8e3aae4876b1 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:52.288682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f5c2b-c72f-4e24-b32e-99b968eaac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:52.289344 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f5c2b-c72f-4e24-b32e-99b968eaac34 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:52.289793 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f5c2b-c72f-4e24-b32e-99b968eaac34 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:52.290283 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f5c2b-c72f-4e24-b32e-99b968eaac34 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:52.291768 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f5c2b-c72f-4e24-b32e-99b968eaac34 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:52.293506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f5c2b-c72f-4e24-b32e-99b968eaac34 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:52.296030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 97/195] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:52 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:52.302500 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f5c2b-c72f-4e24-b32e-99b968eaac34 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:52.344365 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12710fc9-900a-4d9b-bff7-9e00ec9cf8fd None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:52.389619 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329211b-f331-4ffb-adf9-fb89bb196211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:52.391177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329211b-f331-4ffb-adf9-fb89bb196211 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:52.392267 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329211b-f331-4ffb-adf9-fb89bb196211 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:52.392774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329211b-f331-4ffb-adf9-fb89bb196211 None admin] PATH_INFO: `/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:52.394453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329211b-f331-4ffb-adf9-fb89bb196211 None admin] RBAC: Authorizing `identity:get_user(user_id=10aab926644f40b6b3e7c9c7c9fae4fa)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:52.397538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329211b-f331-4ffb-adf9-fb89bb196211 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:52.400285 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 99/196] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:52 2022] GET /identity/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:52.406007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329211b-f331-4ffb-adf9-fb89bb196211 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:52.436637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f5c2b-c72f-4e24-b32e-99b968eaac34 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:52.453376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:52.478662 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94753c31-0d28-4fbb-9d18-55a8628b0e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:52.479712 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94753c31-0d28-4fbb-9d18-55a8628b0e1b None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:52.479993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94753c31-0d28-4fbb-9d18-55a8628b0e1b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:52.480414 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94753c31-0d28-4fbb-9d18-55a8628b0e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:52.481345 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94753c31-0d28-4fbb-9d18-55a8628b0e1b None admin] RBAC: Adding query filter params (role.id=d6d0c56d1054455c813546a2c761a7d0, scope.project.id=2a06dab7f53d450b855338d052303970, user.id=10aab926644f40b6b3e7c9c7c9fae4fa) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:52.482574 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94753c31-0d28-4fbb-9d18-55a8628b0e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:52.484290 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94753c31-0d28-4fbb-9d18-55a8628b0e1b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:52.491635 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 98/197] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:52 2022] GET /identity/v3/role_assignments?user.id=10aab926644f40b6b3e7c9c7c9fae4fa&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:52.533649 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329211b-f331-4ffb-adf9-fb89bb196211 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:52.576678 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a18d51-fd5d-4b97-be84-23b8161a28fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:52.577342 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18d51-fd5d-4b97-be84-23b8161a28fb None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:52.577626 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18d51-fd5d-4b97-be84-23b8161a28fb None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:52.577903 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18d51-fd5d-4b97-be84-23b8161a28fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:52.666652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a18d51-fd5d-4b97-be84-23b8161a28fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:52.668088 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a18d51-fd5d-4b97-be84-23b8161a28fb None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:52.711706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:52.752820 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fd559-7883-4659-a004-94db6bbaf0a0 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:52.753946 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fd559-7883-4659-a004-94db6bbaf0a0 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:52.754256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fd559-7883-4659-a004-94db6bbaf0a0 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:52.756066 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 99/198] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:52.763357 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7b37-fa0a-43a8-ab6b-821d2935a64a None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:52.763927 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7b37-fa0a-43a8-ab6b-821d2935a64a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:52.764402 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7b37-fa0a-43a8-ab6b-821d2935a64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:52.782886 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:52.787604 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-80da7b37-fa0a-43a8-ab6b-821d2935a64a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:52.790123 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 100/199] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:52.803666 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a18d51-fd5d-4b97-be84-23b8161a28fb None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:52.804836 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-80da7b37-fa0a-43a8-ab6b-821d2935a64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:52.956767 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a18d51-fd5d-4b97-be84-23b8161a28fb None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:52.957650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 100/200] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:52.992571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da7b37-fa0a-43a8-ab6b-821d2935a64a None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:52.996697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47050f-264a-4898-94cc-266839165e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:52.997611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47050f-264a-4898-94cc-266839165e20 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:52.998098 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47050f-264a-4898-94cc-266839165e20 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:52.998604 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47050f-264a-4898-94cc-266839165e20 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:53.000108 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47050f-264a-4898-94cc-266839165e20 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:53.001942 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47050f-264a-4898-94cc-266839165e20 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:53.003954 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 101/201] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:52 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:53.011051 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47050f-264a-4898-94cc-266839165e20 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:53.024331 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:53.130729 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47050f-264a-4898-94cc-266839165e20 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:53.169991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ce80-10c3-4d1f-9214-9282f94a2790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:53.170994 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ce80-10c3-4d1f-9214-9282f94a2790 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:53.171511 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ce80-10c3-4d1f-9214-9282f94a2790 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:53.171961 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ce80-10c3-4d1f-9214-9282f94a2790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:53.173589 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385ce80-10c3-4d1f-9214-9282f94a2790 None admin] RBAC: Adding query filter params (role.id=4ff7ba49d92f490cba2d9ef2f9a36e79, scope.project.id=2a06dab7f53d450b855338d052303970, user.id=10aab926644f40b6b3e7c9c7c9fae4fa) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:53.174124 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385ce80-10c3-4d1f-9214-9282f94a2790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:53.175824 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385ce80-10c3-4d1f-9214-9282f94a2790 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:53.182529 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 102/202] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:53 2022] GET /identity/v3/role_assignments?user.id=10aab926644f40b6b3e7c9c7c9fae4fa&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:53.201836 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da7b37-fa0a-43a8-ab6b-821d2935a64a None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:53.236898 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:53.243667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbab09-9834-40c7-86bb-0d71b951c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:53.244335 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbab09-9834-40c7-86bb-0d71b951c015 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:53.244616 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbab09-9834-40c7-86bb-0d71b951c015 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:53.244891 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbab09-9834-40c7-86bb-0d71b951c015 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:53.257642 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbab09-9834-40c7-86bb-0d71b951c015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-8bbbab09-9834-40c7-86bb-0d71b951c015 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:53.262812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:53.263747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:53.264981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 101/203] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:53.270144 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ce80-10c3-4d1f-9214-9282f94a2790 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:53.352797 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:53.401136 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ce80-10c3-4d1f-9214-9282f94a2790 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:53.452801 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ecc22-a5b4-4a6c-9200-d7cffafaa0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:53.453502 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ecc22-a5b4-4a6c-9200-d7cffafaa0bb None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:53.454470 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ecc22-a5b4-4a6c-9200-d7cffafaa0bb None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:53.454920 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ecc22-a5b4-4a6c-9200-d7cffafaa0bb None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:53.455708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ecc22-a5b4-4a6c-9200-d7cffafaa0bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:53.456017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ecc22-a5b4-4a6c-9200-d7cffafaa0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:53.457445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ecc22-a5b4-4a6c-9200-d7cffafaa0bb None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:53.471720 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 103/204] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:51:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:53.477153 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbab09-9834-40c7-86bb-0d71b951c015 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:53.612550 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbab09-9834-40c7-86bb-0d71b951c015 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:53.653957 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ace02-06c4-4686-b13c-bba3126771f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:53.654635 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ace02-06c4-4686-b13c-bba3126771f4 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:53.654928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ace02-06c4-4686-b13c-bba3126771f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:53.655211 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ace02-06c4-4686-b13c-bba3126771f4 None admin] PATH_INFO: `/v3/users/2a1eb1b33be547eb8d4d39a874447186` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:53.656427 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ace02-06c4-4686-b13c-bba3126771f4 None admin] RBAC: Authorizing `identity:get_user(user_id=2a1eb1b33be547eb8d4d39a874447186)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:53.658916 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ace02-06c4-4686-b13c-bba3126771f4 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:53.660548 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 102/205] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:53 2022] GET /identity/v3/users/2a1eb1b33be547eb8d4d39a874447186 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:53.671618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ecc22-a5b4-4a6c-9200-d7cffafaa0bb None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:53.816516 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ecc22-a5b4-4a6c-9200-d7cffafaa0bb None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:53.857735 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:53.867692 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fde4d-53f5-46fe-95ff-4962ace5bdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:53.868258 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fde4d-53f5-46fe-95ff-4962ace5bdd0 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:53.868545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fde4d-53f5-46fe-95ff-4962ace5bdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:53.868828 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fde4d-53f5-46fe-95ff-4962ace5bdd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:53.945597 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fde4d-53f5-46fe-95ff-4962ace5bdd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:53.947203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fde4d-53f5-46fe-95ff-4962ace5bdd0 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:54.068365 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 104/206] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:54.075596 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ace02-06c4-4686-b13c-bba3126771f4 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:54.164327 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:54.211407 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ace02-06c4-4686-b13c-bba3126771f4 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:54.257950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0db8c-db5f-4f66-9cc9-577de1964de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:54.258977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0db8c-db5f-4f66-9cc9-577de1964de3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:54.259465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0db8c-db5f-4f66-9cc9-577de1964de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:54.259942 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0db8c-db5f-4f66-9cc9-577de1964de3 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:54.267937 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0db8c-db5f-4f66-9cc9-577de1964de3 None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:54.269626 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0db8c-db5f-4f66-9cc9-577de1964de3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:54.271564 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 103/207] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:54 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:54.277778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fde4d-53f5-46fe-95ff-4962ace5bdd0 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:54.319554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:54.414415 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fde4d-53f5-46fe-95ff-4962ace5bdd0 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:54.448987 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebea1f-c2dd-4acb-b5a8-d06ac6ffcea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:54.449922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebea1f-c2dd-4acb-b5a8-d06ac6ffcea7 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:54.450604 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebea1f-c2dd-4acb-b5a8-d06ac6ffcea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:54.451142 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebea1f-c2dd-4acb-b5a8-d06ac6ffcea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:54.452102 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebea1f-c2dd-4acb-b5a8-d06ac6ffcea7 None admin] RBAC: Adding query filter params (role.id=1b3ca57e3e474fc79fac8dc29aedc036, scope.project.id=4a43597721514990bc6b893382806592, user.id=2a1eb1b33be547eb8d4d39a874447186) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:54.452606 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebea1f-c2dd-4acb-b5a8-d06ac6ffcea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:54.454807 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebea1f-c2dd-4acb-b5a8-d06ac6ffcea7 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:54.461390 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 105/208] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:54 2022] GET /identity/v3/role_assignments?user.id=2a1eb1b33be547eb8d4d39a874447186&scope.project.id=4a43597721514990bc6b893382806592&role.id=1b3ca57e3e474fc79fac8dc29aedc036 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:55.230544 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622751-70a2-4b62-8c6f-ed2070693044 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.230544 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622751-70a2-4b62-8c6f-ed2070693044 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.230544 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622751-70a2-4b62-8c6f-ed2070693044 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.230544 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 104/209] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:55.237430 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8302111-c36e-434f-b5ab-69a8571d01e8 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.238243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8302111-c36e-434f-b5ab-69a8571d01e8 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.238783 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8302111-c36e-434f-b5ab-69a8571d01e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.258262 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-f8302111-c36e-434f-b5ab-69a8571d01e8 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:55.259823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-f8302111-c36e-434f-b5ab-69a8571d01e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:55.277218 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ce6d2-13d8-41f5-8862-d9d3d19f8ab5 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.277832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ce6d2-13d8-41f5-8862-d9d3d19f8ab5 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.278613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ce6d2-13d8-41f5-8862-d9d3d19f8ab5 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.281382 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 105/210] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:51:55.288995 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3926e5c-7385-43e6-9085-239ac155f27d None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3926e5c-7385-43e6-9085-239ac155f27d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.290323 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3926e5c-7385-43e6-9085-239ac155f27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.309980 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-d3926e5c-7385-43e6-9085-239ac155f27d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:55.311563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-d3926e5c-7385-43e6-9085-239ac155f27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:55.333026 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 106/211] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:55.339821 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ac8f-c71d-423f-99b2-187fba9f064d None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.340115 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ac8f-c71d-423f-99b2-187fba9f064d None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.340394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ac8f-c71d-423f-99b2-187fba9f064d None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.341850 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 107/212] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:55.347820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e651f5-d5b7-412a-bc45-16195d325c13 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.348145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e651f5-d5b7-412a-bc45-16195d325c13 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.348384 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e651f5-d5b7-412a-bc45-16195d325c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.367511 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-27e651f5-d5b7-412a-bc45-16195d325c13 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:55.368707 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-27e651f5-d5b7-412a-bc45-16195d325c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:55.390527 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:55.399211 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 106/213] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:51:55.408109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3926e5c-7385-43e6-9085-239ac155f27d None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:55.445955 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 108/214] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:51:55.455520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e651f5-d5b7-412a-bc45-16195d325c13 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:55.480130 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:55.526968 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3926e5c-7385-43e6-9085-239ac155f27d None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:55.563881 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d0d9-5316-4bbf-9e99-6b25900c9c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:55.564631 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d0d9-5316-4bbf-9e99-6b25900c9c14 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.565087 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d0d9-5316-4bbf-9e99-6b25900c9c14 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.565550 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d0d9-5316-4bbf-9e99-6b25900c9c14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.572075 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e651f5-d5b7-412a-bc45-16195d325c13 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:55.576830 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63d0d9-5316-4bbf-9e99-6b25900c9c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-0d63d0d9-5316-4bbf-9e99-6b25900c9c14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:55.582256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:55.583217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:55.584011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 107/215] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:55.586676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d0d9-5316-4bbf-9e99-6b25900c9c14 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:55.615454 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736921-0c3f-48d3-a38f-22833656cb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:55.616108 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736921-0c3f-48d3-a38f-22833656cb3d None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.616389 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736921-0c3f-48d3-a38f-22833656cb3d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.616673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736921-0c3f-48d3-a38f-22833656cb3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.628007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6736921-0c3f-48d3-a38f-22833656cb3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-b6736921-0c3f-48d3-a38f-22833656cb3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:55.632958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:55.633851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:55.635364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 109/216] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:51:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:55.639581 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736921-0c3f-48d3-a38f-22833656cb3d None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:55.661912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:55.700770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d0d9-5316-4bbf-9e99-6b25900c9c14 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:55.720979 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:55.744325 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c7cb4-8a2a-4f08-bf43-a90051d56c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:55.744981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c7cb4-8a2a-4f08-bf43-a90051d56c42 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.745270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c7cb4-8a2a-4f08-bf43-a90051d56c42 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.745550 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c7cb4-8a2a-4f08-bf43-a90051d56c42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.747184 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c7cb4-8a2a-4f08-bf43-a90051d56c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:55.748948 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c7cb4-8a2a-4f08-bf43-a90051d56c42 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:55.756185 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 108/217] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:55.756185 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c7cb4-8a2a-4f08-bf43-a90051d56c42 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:55.759854 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736921-0c3f-48d3-a38f-22833656cb3d None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:55.801203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cec728-a9ac-49c4-aa2c-7a3c411d76e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:55.801203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cec728-a9ac-49c4-aa2c-7a3c411d76e5 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.801466 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cec728-a9ac-49c4-aa2c-7a3c411d76e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.801785 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cec728-a9ac-49c4-aa2c-7a3c411d76e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.802611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cec728-a9ac-49c4-aa2c-7a3c411d76e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:55.802922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cec728-a9ac-49c4-aa2c-7a3c411d76e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:55.804315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cec728-a9ac-49c4-aa2c-7a3c411d76e5 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:55.818263 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 110/218] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:51:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:55.818263 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cec728-a9ac-49c4-aa2c-7a3c411d76e5 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:55.880605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c7cb4-8a2a-4f08-bf43-a90051d56c42 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:55.914237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:55.920197 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad3026-147b-499f-9f3f-2505f3e40ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:55.921093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3026-147b-499f-9f3f-2505f3e40ea8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.921404 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3026-147b-499f-9f3f-2505f3e40ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.921812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3026-147b-499f-9f3f-2505f3e40ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.922413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad3026-147b-499f-9f3f-2505f3e40ea8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:55.923408 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad3026-147b-499f-9f3f-2505f3e40ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:55.924801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad3026-147b-499f-9f3f-2505f3e40ea8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:55.935705 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 109/219] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:55.936463 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad3026-147b-499f-9f3f-2505f3e40ea8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:55.947428 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cec728-a9ac-49c4-aa2c-7a3c411d76e5 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:55.985243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd61d7-7a88-478f-b447-0d9796fd17e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:55.985895 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd61d7-7a88-478f-b447-0d9796fd17e1 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:55.986178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd61d7-7a88-478f-b447-0d9796fd17e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:55.986459 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd61d7-7a88-478f-b447-0d9796fd17e1 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:55.987186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd61d7-7a88-478f-b447-0d9796fd17e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:55.989090 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd61d7-7a88-478f-b447-0d9796fd17e1 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:55.998447 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:56.022811 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 111/220] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:51:55 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:56.023824 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd61d7-7a88-478f-b447-0d9796fd17e1 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:56.063156 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad3026-147b-499f-9f3f-2505f3e40ea8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:56.102802 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0deed-8ded-40e8-9949-8cb618ba359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:56.103471 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0deed-8ded-40e8-9949-8cb618ba359d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:56.103754 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0deed-8ded-40e8-9949-8cb618ba359d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:56.104028 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0deed-8ded-40e8-9949-8cb618ba359d None admin] PATH_INFO: `/v3/users/ce05adea5b0f477da06d805a911f32ff` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:56.122297 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0deed-8ded-40e8-9949-8cb618ba359d None admin] RBAC: Authorizing `identity:get_user(user_id=ce05adea5b0f477da06d805a911f32ff)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:56.123832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0deed-8ded-40e8-9949-8cb618ba359d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:56.125586 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 110/221] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:55 2022] GET /identity/v3/users/ce05adea5b0f477da06d805a911f32ff => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:56.127151 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229591d7-572b-4ebc-b7c2-5a165ed01025 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:56.127435 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229591d7-572b-4ebc-b7c2-5a165ed01025 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:56.127715 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229591d7-572b-4ebc-b7c2-5a165ed01025 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:56.130550 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 111/222] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:56.133134 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229591d7-572b-4ebc-b7c2-5a165ed01025 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:56.150483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd61d7-7a88-478f-b447-0d9796fd17e1 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:56.188889 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd200e0-3d6c-4387-8e60-690b7c07d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:56.190621 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd200e0-3d6c-4387-8e60-690b7c07d725 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:56.190621 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd200e0-3d6c-4387-8e60-690b7c07d725 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:56.190621 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd200e0-3d6c-4387-8e60-690b7c07d725 None admin] PATH_INFO: `/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:56.191752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd200e0-3d6c-4387-8e60-690b7c07d725 None admin] RBAC: Authorizing `identity:get_user(user_id=10aab926644f40b6b3e7c9c7c9fae4fa)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:56.193247 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd200e0-3d6c-4387-8e60-690b7c07d725 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:56.199625 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 112/223] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:56 2022] GET /identity/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:56.199625 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bcc64-0282-41e1-ace6-f4c9b7c2e9ad None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:56.199625 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bcc64-0282-41e1-ace6-f4c9b7c2e9ad None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:56.199625 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bcc64-0282-41e1-ace6-f4c9b7c2e9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:56.205798 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:56.259368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229591d7-572b-4ebc-b7c2-5a165ed01025 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:56.268376 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:56.305505 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cf8f3-dea3-46b9-bfb8-cbe03c1de1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:56.306164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cf8f3-dea3-46b9-bfb8-cbe03c1de1cb None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:56.306448 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cf8f3-dea3-46b9-bfb8-cbe03c1de1cb None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:56.306763 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cf8f3-dea3-46b9-bfb8-cbe03c1de1cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:56.340536 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-625bcc64-0282-41e1-ace6-f4c9b7c2e9ad None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:56.342205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-625bcc64-0282-41e1-ace6-f4c9b7c2e9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:56.397717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cf8f3-dea3-46b9-bfb8-cbe03c1de1cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:56.399832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cf8f3-dea3-46b9-bfb8-cbe03c1de1cb None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:56.436103 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 113/224] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:56.437103 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bcc64-0282-41e1-ace6-f4c9b7c2e9ad None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:56.526126 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 112/225] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:51:56.527027 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cf8f3-dea3-46b9-bfb8-cbe03c1de1cb None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:56.540470 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:56.555603 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bcc64-0282-41e1-ace6-f4c9b7c2e9ad None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:56.597978 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:56.606376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bef32-3815-4aa5-af91-fef20950893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:56.607469 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bef32-3815-4aa5-af91-fef20950893f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:56.607768 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bef32-3815-4aa5-af91-fef20950893f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:56.608049 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bef32-3815-4aa5-af91-fef20950893f None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:56.609759 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bef32-3815-4aa5-af91-fef20950893f None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:56.612686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bef32-3815-4aa5-af91-fef20950893f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:56.614449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 114/226] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:56 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:56.615655 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bef32-3815-4aa5-af91-fef20950893f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:56.673057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cf8f3-dea3-46b9-bfb8-cbe03c1de1cb None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:56.728474 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4f20d-dbbf-4e58-b0ba-abd661c1aabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:56.729842 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4f20d-dbbf-4e58-b0ba-abd661c1aabb None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:56.730555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4f20d-dbbf-4e58-b0ba-abd661c1aabb None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:56.731037 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4f20d-dbbf-4e58-b0ba-abd661c1aabb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:56.732368 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bef32-3815-4aa5-af91-fef20950893f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:56.747271 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4f20d-dbbf-4e58-b0ba-abd661c1aabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-63c4f20d-dbbf-4e58-b0ba-abd661c1aabb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:56.754237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:56.755252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:51:56.756054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:51:56.758941 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 113/227] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:51:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:56.759880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4f20d-dbbf-4e58-b0ba-abd661c1aabb None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:56.788433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004dddd-afbd-4936-9404-cdc53ac681cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:56.789889 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004dddd-afbd-4936-9404-cdc53ac681cc None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:56.790400 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004dddd-afbd-4936-9404-cdc53ac681cc None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:56.790874 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004dddd-afbd-4936-9404-cdc53ac681cc None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:56.793014 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004dddd-afbd-4936-9404-cdc53ac681cc None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:56.795630 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004dddd-afbd-4936-9404-cdc53ac681cc None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:56.799314 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 115/228] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:56 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:56.800566 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004dddd-afbd-4936-9404-cdc53ac681cc None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:56.843874 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:56.891894 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4f20d-dbbf-4e58-b0ba-abd661c1aabb None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:56.898797 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:56.936701 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004dddd-afbd-4936-9404-cdc53ac681cc None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:56.941469 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59909fa-7623-45e0-9e9c-0e83f3bbdc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:56.942434 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59909fa-7623-45e0-9e9c-0e83f3bbdc85 None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:56.942890 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59909fa-7623-45e0-9e9c-0e83f3bbdc85 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:56.943313 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59909fa-7623-45e0-9e9c-0e83f3bbdc85 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970/users/10aab926644f40b6b3e7c9c7c9fae4fa/roles/d6d0c56d1054455c813546a2c761a7d0` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:56.945550 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59909fa-7623-45e0-9e9c-0e83f3bbdc85 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a06dab7f53d450b855338d052303970, user_id=10aab926644f40b6b3e7c9c7c9fae4fa, role_id=d6d0c56d1054455c813546a2c761a7d0)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:56.947762 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59909fa-7623-45e0-9e9c-0e83f3bbdc85 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:56.972621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 114/229] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:51:56 2022] PUT /identity/v3/projects/2a06dab7f53d450b855338d052303970/users/10aab926644f40b6b3e7c9c7c9fae4fa/roles/d6d0c56d1054455c813546a2c761a7d0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:51:56.972621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59909fa-7623-45e0-9e9c-0e83f3bbdc85 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:56.999677 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3496b-9435-4685-80ad-ddd71b10efb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:57.001569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3496b-9435-4685-80ad-ddd71b10efb8 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:57.002589 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3496b-9435-4685-80ad-ddd71b10efb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:57.002938 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3496b-9435-4685-80ad-ddd71b10efb8 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:57.004180 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3496b-9435-4685-80ad-ddd71b10efb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:57.004884 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3496b-9435-4685-80ad-ddd71b10efb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:57.008422 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3496b-9435-4685-80ad-ddd71b10efb8 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:57.029033 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 116/230] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:51:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:57.037290 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3496b-9435-4685-80ad-ddd71b10efb8 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:57.163944 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59909fa-7623-45e0-9e9c-0e83f3bbdc85 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:57.220671 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:57.233670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fd47a-482e-41c8-97ea-df8969ed8748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:57.234780 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd47a-482e-41c8-97ea-df8969ed8748 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:57.236103 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd47a-482e-41c8-97ea-df8969ed8748 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:57.236684 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd47a-482e-41c8-97ea-df8969ed8748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:57.238057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fd47a-482e-41c8-97ea-df8969ed8748 None admin] RBAC: Adding query filter params (role.id=a2eb0e476c1f497888d73bb1d1771d16, scope.project.id=2a06dab7f53d450b855338d052303970, user.id=ce05adea5b0f477da06d805a911f32ff) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:57.238879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fd47a-482e-41c8-97ea-df8969ed8748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:57.241286 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fd47a-482e-41c8-97ea-df8969ed8748 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:57.249373 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3496b-9435-4685-80ad-ddd71b10efb8 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:57.254161 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 115/231] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:51:56 2022] GET /identity/v3/role_assignments?user.id=ce05adea5b0f477da06d805a911f32ff&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:57.292301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1fe58-4f36-489d-9687-f6b965bf863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:57.292985 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1fe58-4f36-489d-9687-f6b965bf863e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:57.293343 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1fe58-4f36-489d-9687-f6b965bf863e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:57.293630 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1fe58-4f36-489d-9687-f6b965bf863e None admin] PATH_INFO: `/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:57.295016 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1fe58-4f36-489d-9687-f6b965bf863e None admin] RBAC: Authorizing `identity:get_user(user_id=10aab926644f40b6b3e7c9c7c9fae4fa)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:57.295530 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:57.299638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1fe58-4f36-489d-9687-f6b965bf863e None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:57.307039 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 117/232] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:57 2022] GET /identity/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:57.309063 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fd47a-482e-41c8-97ea-df8969ed8748 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:57.460078 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fd47a-482e-41c8-97ea-df8969ed8748 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:57.511871 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af52754-a4ce-468e-9415-a33cf5640c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:57.512916 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af52754-a4ce-468e-9415-a33cf5640c22 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:57.513395 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af52754-a4ce-468e-9415-a33cf5640c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:57.513895 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af52754-a4ce-468e-9415-a33cf5640c22 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:57.515496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af52754-a4ce-468e-9415-a33cf5640c22 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:57.518035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af52754-a4ce-468e-9415-a33cf5640c22 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:57.520236 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 116/233] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:51:57 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:57.526782 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1fe58-4f36-489d-9687-f6b965bf863e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:57.685807 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1fe58-4f36-489d-9687-f6b965bf863e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:57.727690 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcfe9e-5b21-4ee6-8593-74cc58a97e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:57.728300 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcfe9e-5b21-4ee6-8593-74cc58a97e22 None admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:57.728577 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcfe9e-5b21-4ee6-8593-74cc58a97e22 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:57.728865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcfe9e-5b21-4ee6-8593-74cc58a97e22 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970/users/10aab926644f40b6b3e7c9c7c9fae4fa/roles/4ff7ba49d92f490cba2d9ef2f9a36e79` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:57.732951 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcfe9e-5b21-4ee6-8593-74cc58a97e22 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a06dab7f53d450b855338d052303970, user_id=10aab926644f40b6b3e7c9c7c9fae4fa, role_id=4ff7ba49d92f490cba2d9ef2f9a36e79)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:57.734417 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcfe9e-5b21-4ee6-8593-74cc58a97e22 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:57.761699 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 118/234] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:51:57 2022] PUT /identity/v3/projects/2a06dab7f53d450b855338d052303970/users/10aab926644f40b6b3e7c9c7c9fae4fa/roles/4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:51:58.823901 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6148327-f25d-4902-875d-67da30e99715 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:58.824880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6148327-f25d-4902-875d-67da30e99715 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:58.825359 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6148327-f25d-4902-875d-67da30e99715 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:58.827322 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 117/235] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:58.832992 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29514c3-7352-4ec2-82ae-bbd361ff3357 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:58.833479 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29514c3-7352-4ec2-82ae-bbd361ff3357 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:58.833554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29514c3-7352-4ec2-82ae-bbd361ff3357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:58.863855 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-a29514c3-7352-4ec2-82ae-bbd361ff3357 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:58.865067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-a29514c3-7352-4ec2-82ae-bbd361ff3357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:58.936362 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:58.957414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 119/236] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:58.998370 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6148327-f25d-4902-875d-67da30e99715 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:59.003309 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de080ba7-9014-476e-bada-3829452817b6 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:59.003600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de080ba7-9014-476e-bada-3829452817b6 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:59.003881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de080ba7-9014-476e-bada-3829452817b6 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:59.005525 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 120/237] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:59.010443 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d346068-29e4-4868-89a8-119627491e52 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:59.010775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d346068-29e4-4868-89a8-119627491e52 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:59.011068 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d346068-29e4-4868-89a8-119627491e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:59.047140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-3d346068-29e4-4868-89a8-119627491e52 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:59.049099 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-3d346068-29e4-4868-89a8-119627491e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:59.125921 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 121/238] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:51:59.153424 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d346068-29e4-4868-89a8-119627491e52 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:59.156488 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:59.268309 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6148327-f25d-4902-875d-67da30e99715 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:59.288392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d346068-29e4-4868-89a8-119627491e52 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:59.315006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:59.328457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33af576-e5f6-4e7e-9ad1-016d2f01c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:59.329514 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af576-e5f6-4e7e-9ad1-016d2f01c6cc None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:59.329750 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af576-e5f6-4e7e-9ad1-016d2f01c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:59.330337 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af576-e5f6-4e7e-9ad1-016d2f01c6cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:59.342637 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33af576-e5f6-4e7e-9ad1-016d2f01c6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:51:59.348244 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9965a21-df58-44c8-9fd0-b61fd9287a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:59.348898 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9965a21-df58-44c8-9fd0-b61fd9287a4f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-a33af576-e5f6-4e7e-9ad1-016d2f01c6cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:51:59.349006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:51:59.349862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:51:59.351091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:51:59.351963 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9965a21-df58-44c8-9fd0-b61fd9287a4f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:59.351963 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9965a21-df58-44c8-9fd0-b61fd9287a4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:59.352097 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 122/239] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:51:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:51:59.355442 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9965a21-df58-44c8-9fd0-b61fd9287a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:59.356557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33af576-e5f6-4e7e-9ad1-016d2f01c6cc None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:59.357082 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9965a21-df58-44c8-9fd0-b61fd9287a4f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:59.359056 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 118/240] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:51:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:51:59.366610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9965a21-df58-44c8-9fd0-b61fd9287a4f None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:59.470613 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33af576-e5f6-4e7e-9ad1-016d2f01c6cc None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:59.512957 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed35f-ff5c-4216-a043-b8566c9c733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:59.513596 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed35f-ff5c-4216-a043-b8566c9c733e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:59.513882 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed35f-ff5c-4216-a043-b8566c9c733e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:59.514161 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed35f-ff5c-4216-a043-b8566c9c733e None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:59.520283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed35f-ff5c-4216-a043-b8566c9c733e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:51:59.520623 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed35f-ff5c-4216-a043-b8566c9c733e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:59.523240 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed35f-ff5c-4216-a043-b8566c9c733e None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:59.552417 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 123/241] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:51:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:59.560563 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed35f-ff5c-4216-a043-b8566c9c733e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:59.618914 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:59.678395 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed35f-ff5c-4216-a043-b8566c9c733e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:59.716480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9965a21-df58-44c8-9fd0-b61fd9287a4f None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:59.718485 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48157b-17e8-4ba5-b5e7-32db78390bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:59.720750 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48157b-17e8-4ba5-b5e7-32db78390bc9 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:59.721057 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48157b-17e8-4ba5-b5e7-32db78390bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:59.721346 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48157b-17e8-4ba5-b5e7-32db78390bc9 None admin] PATH_INFO: `/v3/users/7e1529b22b0646a081a928132b1b9f5e` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:59.737278 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48157b-17e8-4ba5-b5e7-32db78390bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=7e1529b22b0646a081a928132b1b9f5e)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:59.738826 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48157b-17e8-4ba5-b5e7-32db78390bc9 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:59.741303 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 124/242] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:51:59 2022] GET /identity/v3/users/7e1529b22b0646a081a928132b1b9f5e => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:51:59.747115 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48157b-17e8-4ba5-b5e7-32db78390bc9 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:51:59.812206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:59.839392 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0200941-bd54-4b4d-90d6-ab4a429fe31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:59.840729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0200941-bd54-4b4d-90d6-ab4a429fe31b None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:59.841170 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0200941-bd54-4b4d-90d6-ab4a429fe31b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:59.841601 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0200941-bd54-4b4d-90d6-ab4a429fe31b None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:59.842449 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0200941-bd54-4b4d-90d6-ab4a429fe31b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:51:59.844194 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0200941-bd54-4b4d-90d6-ab4a429fe31b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:51:59.864638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:51:59.869680 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48157b-17e8-4ba5-b5e7-32db78390bc9 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:51:59.874065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 119/243] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:51:59 2022] POST /identity/v3/users => generated 293 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:51:59.880481 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c52fcf-5554-454b-95f4-505be100723a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:59.881028 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c52fcf-5554-454b-95f4-505be100723a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:59.881456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c52fcf-5554-454b-95f4-505be100723a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:59.890539 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 120/244] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:51:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:51:59.890539 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67aff1-a2de-44a3-adfe-def03d3a5710 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:59.890539 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67aff1-a2de-44a3-adfe-def03d3a5710 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:59.890539 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67aff1-a2de-44a3-adfe-def03d3a5710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:51:59.934681 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-7e67aff1-a2de-44a3-adfe-def03d3a5710 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:51:59.936915 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-7e67aff1-a2de-44a3-adfe-def03d3a5710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:51:59.950740 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251c43-4731-4d30-9d17-88ada1e13315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:51:59.951611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251c43-4731-4d30-9d17-88ada1e13315 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:51:59.956972 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251c43-4731-4d30-9d17-88ada1e13315 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:51:59.956972 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251c43-4731-4d30-9d17-88ada1e13315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:00.093819 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 121/245] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:00.096762 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2b090-4289-4aad-8fdc-d89181ed9b4a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:00.096762 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2b090-4289-4aad-8fdc-d89181ed9b4a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:00.096762 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2b090-4289-4aad-8fdc-d89181ed9b4a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:00.097943 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 122/246] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:00.103429 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e19f33-7b55-4e83-9432-64670ef90ab5 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:00.103721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e19f33-7b55-4e83-9432-64670ef90ab5 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:00.104010 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e19f33-7b55-4e83-9432-64670ef90ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:00.104111 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0251c43-4731-4d30-9d17-88ada1e13315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:00.105497 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0251c43-4731-4d30-9d17-88ada1e13315 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:00.123256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-a2e19f33-7b55-4e83-9432-64670ef90ab5 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:00.124448 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-a2e19f33-7b55-4e83-9432-64670ef90ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:00.210498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 123/247] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:00.211857 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e19f33-7b55-4e83-9432-64670ef90ab5 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:00.227890 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:00.231949 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 125/248] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:00.237928 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251c43-4731-4d30-9d17-88ada1e13315 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:00.268981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:00.355445 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e19f33-7b55-4e83-9432-64670ef90ab5 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:00.387689 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251c43-4731-4d30-9d17-88ada1e13315 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:00.401069 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16f36-f90c-4356-8af3-1fc09b503b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:00.402648 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16f36-f90c-4356-8af3-1fc09b503b28 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:00.402967 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16f36-f90c-4356-8af3-1fc09b503b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:00.403252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16f36-f90c-4356-8af3-1fc09b503b28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:00.418733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df16f36-f90c-4356-8af3-1fc09b503b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-7df16f36-f90c-4356-8af3-1fc09b503b28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:00.427065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:00.428024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:00.428827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:00.432594 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 124/249] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:52:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:00.433635 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16f36-f90c-4356-8af3-1fc09b503b28 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:00.439985 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c2f28-f194-4d46-8363-ccaba4aa6422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:00.439985 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c2f28-f194-4d46-8363-ccaba4aa6422 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:00.440257 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c2f28-f194-4d46-8363-ccaba4aa6422 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:00.440476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c2f28-f194-4d46-8363-ccaba4aa6422 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:00.442334 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c2f28-f194-4d46-8363-ccaba4aa6422 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:00.443854 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c2f28-f194-4d46-8363-ccaba4aa6422 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:00.445673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 126/250] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:00 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:00.450573 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c2f28-f194-4d46-8363-ccaba4aa6422 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:00.543196 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:00.581967 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16f36-f90c-4356-8af3-1fc09b503b28 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:00.584289 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:00.590759 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c2f28-f194-4d46-8363-ccaba4aa6422 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:00.630640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdfb5f-f1c1-42ec-acdb-0410fb4952e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:00.631545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdfb5f-f1c1-42ec-acdb-0410fb4952e5 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:00.631973 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdfb5f-f1c1-42ec-acdb-0410fb4952e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:00.632401 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdfb5f-f1c1-42ec-acdb-0410fb4952e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:00.633321 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc478d32-2b96-420e-845e-b0291fd07df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:00.633492 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdfb5f-f1c1-42ec-acdb-0410fb4952e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:00.633934 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdfb5f-f1c1-42ec-acdb-0410fb4952e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:00.634044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc478d32-2b96-420e-845e-b0291fd07df5 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:00.634243 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc478d32-2b96-420e-845e-b0291fd07df5 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:00.634534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc478d32-2b96-420e-845e-b0291fd07df5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:00.635880 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdfb5f-f1c1-42ec-acdb-0410fb4952e5 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:00.646891 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 127/251] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:00.651896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdfb5f-f1c1-42ec-acdb-0410fb4952e5 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:00.652554 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc478d32-2b96-420e-845e-b0291fd07df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-fc478d32-2b96-420e-845e-b0291fd07df5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:00.658803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:00.659720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:00.660531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:00.663066 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 125/252] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:00.664524 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235a408-77ec-4538-a73d-b46b181e8f54 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:00.664913 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235a408-77ec-4538-a73d-b46b181e8f54 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:00.665292 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235a408-77ec-4538-a73d-b46b181e8f54 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:00.666698 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 126/253] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:00.671298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235a408-77ec-4538-a73d-b46b181e8f54 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:00.784514 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdfb5f-f1c1-42ec-acdb-0410fb4952e5 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:00.834538 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235a408-77ec-4538-a73d-b46b181e8f54 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:00.835535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:00.838794 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fe086-4ccf-4283-88c2-7a435de9d98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:00.839737 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe086-4ccf-4283-88c2-7a435de9d98d None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:00.840183 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe086-4ccf-4283-88c2-7a435de9d98d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:00.840670 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe086-4ccf-4283-88c2-7a435de9d98d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:00.841676 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fe086-4ccf-4283-88c2-7a435de9d98d None admin] RBAC: Adding query filter params (role.id=1b3ca57e3e474fc79fac8dc29aedc036, scope.project.id=2a06dab7f53d450b855338d052303970, user.id=7e1529b22b0646a081a928132b1b9f5e) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:00.842088 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fe086-4ccf-4283-88c2-7a435de9d98d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:00.843690 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fe086-4ccf-4283-88c2-7a435de9d98d None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:00.859025 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 128/254] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:00 2022] GET /identity/v3/role_assignments?user.id=7e1529b22b0646a081a928132b1b9f5e&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=1b3ca57e3e474fc79fac8dc29aedc036 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:00.860212 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fe086-4ccf-4283-88c2-7a435de9d98d None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:00.877254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4019ec-91c1-4b01-9c5e-b25dbf9e7b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:00.878586 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4019ec-91c1-4b01-9c5e-b25dbf9e7b14 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:00.879011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4019ec-91c1-4b01-9c5e-b25dbf9e7b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:00.879441 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4019ec-91c1-4b01-9c5e-b25dbf9e7b14 None admin] PATH_INFO: `/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:00.881563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4019ec-91c1-4b01-9c5e-b25dbf9e7b14 None admin] RBAC: Authorizing `identity:get_user(user_id=10aab926644f40b6b3e7c9c7c9fae4fa)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:00.883732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4019ec-91c1-4b01-9c5e-b25dbf9e7b14 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:00.885805 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 127/255] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:00 2022] GET /identity/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:00.887613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa845f-e989-479a-88eb-982b333486b0 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:00.888088 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa845f-e989-479a-88eb-982b333486b0 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:00.888539 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa845f-e989-479a-88eb-982b333486b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:00.911668 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-40aa845f-e989-479a-88eb-982b333486b0 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:00.913478 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-40aa845f-e989-479a-88eb-982b333486b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:00.969960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:01.029717 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fe086-4ccf-4283-88c2-7a435de9d98d None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:01.071545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599c924-d570-4312-999b-5ec777fe2e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:01.072539 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c924-d570-4312-999b-5ec777fe2e91 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:01.073047 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c924-d570-4312-999b-5ec777fe2e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:01.073520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c924-d570-4312-999b-5ec777fe2e91 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:01.074463 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599c924-d570-4312-999b-5ec777fe2e91 None admin] RBAC: Adding query filter params (name=member) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:01.075170 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599c924-d570-4312-999b-5ec777fe2e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:01.076990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599c924-d570-4312-999b-5ec777fe2e91 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:01.092080 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 129/256] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:01.093636 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599c924-d570-4312-999b-5ec777fe2e91 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:01.133147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 128/257] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:01.133147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa845f-e989-479a-88eb-982b333486b0 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:01.173573 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:01.244191 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa845f-e989-479a-88eb-982b333486b0 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:01.257208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599c924-d570-4312-999b-5ec777fe2e91 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:01.287658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f6740-b9bd-45ef-b012-06e4856cc8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:01.287658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f6740-b9bd-45ef-b012-06e4856cc8e6 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:01.287658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f6740-b9bd-45ef-b012-06e4856cc8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:01.287658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f6740-b9bd-45ef-b012-06e4856cc8e6 None admin] PATH_INFO: `/v3/users/ce05adea5b0f477da06d805a911f32ff` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:01.288857 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f6740-b9bd-45ef-b012-06e4856cc8e6 None admin] RBAC: Authorizing `identity:get_user(user_id=ce05adea5b0f477da06d805a911f32ff)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:01.290315 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f6740-b9bd-45ef-b012-06e4856cc8e6 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:01.293139 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 129/258] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:01 2022] GET /identity/v3/users/ce05adea5b0f477da06d805a911f32ff => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:01.293711 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f6740-b9bd-45ef-b012-06e4856cc8e6 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:01.331387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96238b-7963-4cb2-a23e-2c100743a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:01.332025 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96238b-7963-4cb2-a23e-2c100743a68c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:01.332309 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96238b-7963-4cb2-a23e-2c100743a68c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:01.332590 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96238b-7963-4cb2-a23e-2c100743a68c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:01.364856 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:01.416998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96238b-7963-4cb2-a23e-2c100743a68c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:01.418551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96238b-7963-4cb2-a23e-2c100743a68c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:01.503021 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:01.544966 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f6740-b9bd-45ef-b012-06e4856cc8e6 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:01.571217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 130/259] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:01.572112 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96238b-7963-4cb2-a23e-2c100743a68c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:01.627544 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2f8ec-d5ed-41c9-b0f2-845e6e48273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:01.628200 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2f8ec-d5ed-41c9-b0f2-845e6e48273a None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:01.628640 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2f8ec-d5ed-41c9-b0f2-845e6e48273a None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:01.628921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2f8ec-d5ed-41c9-b0f2-845e6e48273a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:01.651474 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2f8ec-d5ed-41c9-b0f2-845e6e48273a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-a7c2f8ec-d5ed-41c9-b0f2-845e6e48273a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:01.656377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:01.657333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:01.658209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 130/260] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:52:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:01.658893 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2f8ec-d5ed-41c9-b0f2-845e6e48273a None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:01.761858 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96238b-7963-4cb2-a23e-2c100743a68c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:01.813111 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:01.829750 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded3866-d559-47fb-b625-d1eb16675234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:01.830407 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded3866-d559-47fb-b625-d1eb16675234 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:01.830709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded3866-d559-47fb-b625-d1eb16675234 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:01.830981 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded3866-d559-47fb-b625-d1eb16675234 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:01.832807 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded3866-d559-47fb-b625-d1eb16675234 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:01.834259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded3866-d559-47fb-b625-d1eb16675234 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:01.836160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 131/261] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:01 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:01.836704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded3866-d559-47fb-b625-d1eb16675234 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:01.839666 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2f8ec-d5ed-41c9-b0f2-845e6e48273a None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:01.887167 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:01.900482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc568ef-38d2-4ed9-8db4-9bf58c03fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:01.901192 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc568ef-38d2-4ed9-8db4-9bf58c03fda9 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:01.901478 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc568ef-38d2-4ed9-8db4-9bf58c03fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:01.901751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc568ef-38d2-4ed9-8db4-9bf58c03fda9 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:01.903533 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc568ef-38d2-4ed9-8db4-9bf58c03fda9 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:01.907330 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc568ef-38d2-4ed9-8db4-9bf58c03fda9 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:01.909093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 131/262] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:01 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:01.909843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc568ef-38d2-4ed9-8db4-9bf58c03fda9 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:02.013436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded3866-d559-47fb-b625-d1eb16675234 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:02.051079 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0ffa8-f3f1-4464-a580-059d32ade44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:02.053265 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0ffa8-f3f1-4464-a580-059d32ade44a None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:02.054030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0ffa8-f3f1-4464-a580-059d32ade44a None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:02.054698 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0ffa8-f3f1-4464-a580-059d32ade44a None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:02.055858 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0ffa8-f3f1-4464-a580-059d32ade44a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:02.056390 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0ffa8-f3f1-4464-a580-059d32ade44a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:02.058001 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0ffa8-f3f1-4464-a580-059d32ade44a None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:02.067462 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 132/263] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:02.068569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0ffa8-f3f1-4464-a580-059d32ade44a None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:02.128649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc568ef-38d2-4ed9-8db4-9bf58c03fda9 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:02.162888 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:02.179677 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0ffa8-f3f1-4464-a580-059d32ade44a None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:02.222689 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460273e-506e-4ab3-8f42-abcc36b507c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:02.223326 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460273e-506e-4ab3-8f42-abcc36b507c6 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:02.223611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460273e-506e-4ab3-8f42-abcc36b507c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:02.223895 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460273e-506e-4ab3-8f42-abcc36b507c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:02.224702 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460273e-506e-4ab3-8f42-abcc36b507c6 None admin] RBAC: Adding query filter params (role.id=d6d0c56d1054455c813546a2c761a7d0, scope.project.id=2a06dab7f53d450b855338d052303970, user.id=10aab926644f40b6b3e7c9c7c9fae4fa) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:02.225024 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460273e-506e-4ab3-8f42-abcc36b507c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:02.226483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460273e-506e-4ab3-8f42-abcc36b507c6 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:02.232261 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e3d26-56d6-4258-b11b-9a49f82158fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:02.232955 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e3d26-56d6-4258-b11b-9a49f82158fc None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:02.233245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e3d26-56d6-4258-b11b-9a49f82158fc None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:02.233528 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e3d26-56d6-4258-b11b-9a49f82158fc None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970/users/ce05adea5b0f477da06d805a911f32ff/roles/a2eb0e476c1f497888d73bb1d1771d16` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:02.237098 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e3d26-56d6-4258-b11b-9a49f82158fc None admin] RBAC: Authorizing `identity:create_grant(project_id=2a06dab7f53d450b855338d052303970, user_id=ce05adea5b0f477da06d805a911f32ff, role_id=a2eb0e476c1f497888d73bb1d1771d16)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:02.238566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e3d26-56d6-4258-b11b-9a49f82158fc None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:02.243080 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 133/264] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:02 2022] GET /identity/v3/role_assignments?user.id=10aab926644f40b6b3e7c9c7c9fae4fa&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:02.243935 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460273e-506e-4ab3-8f42-abcc36b507c6 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:02.262353 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 132/265] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:52:01 2022] PUT /identity/v3/projects/2a06dab7f53d450b855338d052303970/users/ce05adea5b0f477da06d805a911f32ff/roles/a2eb0e476c1f497888d73bb1d1771d16 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:02.404895 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460273e-506e-4ab3-8f42-abcc36b507c6 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:02.455272 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb4cd2-fae1-40a9-b5dd-717ad5c88959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:02.456037 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb4cd2-fae1-40a9-b5dd-717ad5c88959 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:02.456320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb4cd2-fae1-40a9-b5dd-717ad5c88959 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:02.456599 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb4cd2-fae1-40a9-b5dd-717ad5c88959 None admin] PATH_INFO: `/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:02.457887 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb4cd2-fae1-40a9-b5dd-717ad5c88959 None admin] RBAC: Authorizing `identity:get_user(user_id=10aab926644f40b6b3e7c9c7c9fae4fa)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:02.459417 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb4cd2-fae1-40a9-b5dd-717ad5c88959 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:02.461369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 134/266] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:02 2022] GET /identity/v3/users/10aab926644f40b6b3e7c9c7c9fae4fa => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:02.467842 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e3d26-56d6-4258-b11b-9a49f82158fc None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:02.494809 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:02.616877 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e3d26-56d6-4258-b11b-9a49f82158fc None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:02.661759 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d37f15-3fe9-49ed-8342-d0e60b2f2c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:02.662315 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d37f15-3fe9-49ed-8342-d0e60b2f2c4d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:02.662634 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d37f15-3fe9-49ed-8342-d0e60b2f2c4d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:02.662911 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d37f15-3fe9-49ed-8342-d0e60b2f2c4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:02.740268 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d37f15-3fe9-49ed-8342-d0e60b2f2c4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:02.741738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d37f15-3fe9-49ed-8342-d0e60b2f2c4d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:02.759953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:02.860729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 133/267] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:02.866756 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb4cd2-fae1-40a9-b5dd-717ad5c88959 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:02.890041 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:02.897341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b089b6-f587-43a3-b462-a9496db82714 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:02.897940 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b089b6-f587-43a3-b462-a9496db82714 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:02.898407 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b089b6-f587-43a3-b462-a9496db82714 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:02.900964 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 134/268] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:02.907491 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40e60a-12f1-4188-9c03-bad83e8d7e73 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:02.908057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40e60a-12f1-4188-9c03-bad83e8d7e73 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:02.908503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40e60a-12f1-4188-9c03-bad83e8d7e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:02.953140 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-1b40e60a-12f1-4188-9c03-bad83e8d7e73 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:02.957073 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-1b40e60a-12f1-4188-9c03-bad83e8d7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:03.040230 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb4cd2-fae1-40a9-b5dd-717ad5c88959 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:03.099925 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b978d-48bd-4120-9787-307237d4f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:03.101392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b978d-48bd-4120-9787-307237d4f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:03.101926 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b978d-48bd-4120-9787-307237d4f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:03.102382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b978d-48bd-4120-9787-307237d4f6b3 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:03.103918 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b978d-48bd-4120-9787-307237d4f6b3 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:03.105606 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b978d-48bd-4120-9787-307237d4f6b3 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:03.118915 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 135/269] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:02 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:03.119767 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b978d-48bd-4120-9787-307237d4f6b3 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:03.223935 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:03.243113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b978d-48bd-4120-9787-307237d4f6b3 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:03.244404 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 135/270] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:03.246088 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890d14f-5eff-40be-87da-35fd9eded594 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:03.246643 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890d14f-5eff-40be-87da-35fd9eded594 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:03.247115 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890d14f-5eff-40be-87da-35fd9eded594 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:03.248618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 136/271] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:03.256575 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312f5e3-8f91-4f97-9e0c-7366b140881d None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:03.257166 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312f5e3-8f91-4f97-9e0c-7366b140881d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:03.257636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312f5e3-8f91-4f97-9e0c-7366b140881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:03.279900 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-e312f5e3-8f91-4f97-9e0c-7366b140881d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:03.281942 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-e312f5e3-8f91-4f97-9e0c-7366b140881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:03.312271 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3acb-4a91-4659-935b-ae19ead0c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:03.312898 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3acb-4a91-4659-935b-ae19ead0c29c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:03.313240 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3acb-4a91-4659-935b-ae19ead0c29c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:03.314144 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3acb-4a91-4659-935b-ae19ead0c29c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:03.315384 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b3acb-4a91-4659-935b-ae19ead0c29c None admin] RBAC: Adding query filter params (role.id=4ff7ba49d92f490cba2d9ef2f9a36e79, scope.project.id=2a06dab7f53d450b855338d052303970, user.id=10aab926644f40b6b3e7c9c7c9fae4fa) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:03.315701 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b3acb-4a91-4659-935b-ae19ead0c29c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:03.317207 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b3acb-4a91-4659-935b-ae19ead0c29c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:03.326558 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 136/272] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:03 2022] GET /identity/v3/role_assignments?user.id=10aab926644f40b6b3e7c9c7c9fae4fa&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:03.326558 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3acb-4a91-4659-935b-ae19ead0c29c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:03.362908 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:03.419029 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 137/273] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:03.465510 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312f5e3-8f91-4f97-9e0c-7366b140881d None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:03.506579 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3acb-4a91-4659-935b-ae19ead0c29c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:03.562528 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1d840-3e10-452f-9abe-ad576b8d17f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:03.563641 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1d840-3e10-452f-9abe-ad576b8d17f3 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:03.563952 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1d840-3e10-452f-9abe-ad576b8d17f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:03.564325 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1d840-3e10-452f-9abe-ad576b8d17f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:03.565701 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1d840-3e10-452f-9abe-ad576b8d17f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:03.567678 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1d840-3e10-452f-9abe-ad576b8d17f3 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:03.570153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 137/274] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:03.576537 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1d840-3e10-452f-9abe-ad576b8d17f3 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:03.601386 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:03.658592 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312f5e3-8f91-4f97-9e0c-7366b140881d None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:03.693556 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb73912-3e2a-4e27-aad7-897069b559d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:03.694214 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73912-3e2a-4e27-aad7-897069b559d7 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:03.694499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73912-3e2a-4e27-aad7-897069b559d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:03.694824 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73912-3e2a-4e27-aad7-897069b559d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:03.706619 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1d840-3e10-452f-9abe-ad576b8d17f3 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:03.707357 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb73912-3e2a-4e27-aad7-897069b559d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-acb73912-3e2a-4e27-aad7-897069b559d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:03.712369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:03.713252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:03.714057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:03.714682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 138/275] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:03.724908 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb73912-3e2a-4e27-aad7-897069b559d7 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:03.748974 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d5a4e-5ebe-4755-8627-6c84327b7bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:03.749742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d5a4e-5ebe-4755-8627-6c84327b7bbf None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:03.750034 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d5a4e-5ebe-4755-8627-6c84327b7bbf None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:03.750318 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d5a4e-5ebe-4755-8627-6c84327b7bbf None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:03.751898 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d5a4e-5ebe-4755-8627-6c84327b7bbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:03.753463 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d5a4e-5ebe-4755-8627-6c84327b7bbf None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:03.801563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:03.810868 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 138/276] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:52:03 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:52:03.861908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f833b3-9c81-4cb6-9b96-79149b266cc8 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:03.861908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f833b3-9c81-4cb6-9b96-79149b266cc8 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:03.861908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f833b3-9c81-4cb6-9b96-79149b266cc8 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:03.867223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 139/277] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:03.869615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95df77-47c0-4d82-802c-ac5d6cfffcef None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:03.869615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95df77-47c0-4d82-802c-ac5d6cfffcef None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:03.869805 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95df77-47c0-4d82-802c-ac5d6cfffcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:03.892528 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-8e95df77-47c0-4d82-802c-ac5d6cfffcef None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:03.894576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-8e95df77-47c0-4d82-802c-ac5d6cfffcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:03.909778 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb73912-3e2a-4e27-aad7-897069b559d7 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:03.963860 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de10c61-d653-43fa-9c09-e29b0e151113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:03.964494 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10c61-d653-43fa-9c09-e29b0e151113 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:03.964847 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10c61-d653-43fa-9c09-e29b0e151113 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:03.965197 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10c61-d653-43fa-9c09-e29b0e151113 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:03.966056 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de10c61-d653-43fa-9c09-e29b0e151113 None admin] RBAC: Adding query filter params (name=member) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:03.966470 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de10c61-d653-43fa-9c09-e29b0e151113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:03.968170 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de10c61-d653-43fa-9c09-e29b0e151113 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:03.979494 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 139/278] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:03.987914 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de10c61-d653-43fa-9c09-e29b0e151113 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:03.992647 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 140/279] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:04.019071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95df77-47c0-4d82-802c-ac5d6cfffcef None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:04.021601 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:04.109541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:04.115353 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de10c61-d653-43fa-9c09-e29b0e151113 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:04.153723 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95df77-47c0-4d82-802c-ac5d6cfffcef None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:04.159493 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c993d3-22e5-4ddf-9f38-3ed749be6ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:04.160156 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c993d3-22e5-4ddf-9f38-3ed749be6ec4 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:04.160436 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c993d3-22e5-4ddf-9f38-3ed749be6ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:04.160707 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c993d3-22e5-4ddf-9f38-3ed749be6ec4 None admin] PATH_INFO: `/v3/users/031027bdd22a46149c56ef40a5758bf5` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:04.180471 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c993d3-22e5-4ddf-9f38-3ed749be6ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=031027bdd22a46149c56ef40a5758bf5)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:04.182688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c993d3-22e5-4ddf-9f38-3ed749be6ec4 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:04.185540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 140/280] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:03 2022] GET /identity/v3/users/031027bdd22a46149c56ef40a5758bf5 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:04.191468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c993d3-22e5-4ddf-9f38-3ed749be6ec4 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:04.200405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c93b15-0c89-4256-93fe-b5a69a1e5017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:04.201168 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c93b15-0c89-4256-93fe-b5a69a1e5017 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:04.201521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c93b15-0c89-4256-93fe-b5a69a1e5017 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:04.201865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c93b15-0c89-4256-93fe-b5a69a1e5017 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:04.221432 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c93b15-0c89-4256-93fe-b5a69a1e5017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-37c93b15-0c89-4256-93fe-b5a69a1e5017 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:04.226569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:04.227483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:52:04.228301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:04.230978 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 141/281] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:04.234171 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c93b15-0c89-4256-93fe-b5a69a1e5017 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:04.317378 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:04.334750 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c993d3-22e5-4ddf-9f38-3ed749be6ec4 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:04.375616 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c93b15-0c89-4256-93fe-b5a69a1e5017 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:04.401808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a117aa-972c-4286-9325-602d5673284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:04.402443 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a117aa-972c-4286-9325-602d5673284f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:04.402753 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a117aa-972c-4286-9325-602d5673284f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:04.403069 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a117aa-972c-4286-9325-602d5673284f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:04.403860 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a117aa-972c-4286-9325-602d5673284f None admin] RBAC: Adding query filter params (role.id=a2eb0e476c1f497888d73bb1d1771d16, user.id=031027bdd22a46149c56ef40a5758bf5, scope.system=all) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:04.404170 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a117aa-972c-4286-9325-602d5673284f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:04.405627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a117aa-972c-4286-9325-602d5673284f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:04.420823 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 141/282] 10.222.0.73 () {56 vars in 1308 bytes} [Wed Jul 27 17:52:04 2022] GET /identity/v3/role_assignments?user.id=031027bdd22a46149c56ef40a5758bf5&scope.system=all&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:04.437587 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a8767-e231-4630-8c06-363de1d494c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:04.438231 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a8767-e231-4630-8c06-363de1d494c8 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:04.438796 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a8767-e231-4630-8c06-363de1d494c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:04.439300 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a8767-e231-4630-8c06-363de1d494c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:04.440248 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a8767-e231-4630-8c06-363de1d494c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:04.440563 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a8767-e231-4630-8c06-363de1d494c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:04.442044 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a8767-e231-4630-8c06-363de1d494c8 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:04.451914 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 142/283] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:04.458974 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a117aa-972c-4286-9325-602d5673284f None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:04.491287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:04.613338 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a117aa-972c-4286-9325-602d5673284f None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:04.684774 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953a7fc-7fb7-445a-af44-1996aa1a3571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:04.685752 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953a7fc-7fb7-445a-af44-1996aa1a3571 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:04.686230 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953a7fc-7fb7-445a-af44-1996aa1a3571 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:04.686736 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953a7fc-7fb7-445a-af44-1996aa1a3571 None admin] PATH_INFO: `/v3/users/7e1529b22b0646a081a928132b1b9f5e` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:04.688218 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953a7fc-7fb7-445a-af44-1996aa1a3571 None admin] RBAC: Authorizing `identity:get_user(user_id=7e1529b22b0646a081a928132b1b9f5e)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:04.690022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953a7fc-7fb7-445a-af44-1996aa1a3571 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:04.692251 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 142/284] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:04 2022] GET /identity/v3/users/7e1529b22b0646a081a928132b1b9f5e => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:04.697599 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a8767-e231-4630-8c06-363de1d494c8 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:04.819097 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a8767-e231-4630-8c06-363de1d494c8 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:04.844056 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:04.855561 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3254f-a776-48a3-990d-d0e72c09ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:04.856211 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3254f-a776-48a3-990d-d0e72c09ad75 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:04.856493 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3254f-a776-48a3-990d-d0e72c09ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:04.856773 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3254f-a776-48a3-990d-d0e72c09ad75 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:04.857957 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3254f-a776-48a3-990d-d0e72c09ad75 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:04.859426 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3254f-a776-48a3-990d-d0e72c09ad75 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:04.866464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 143/285] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:04 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:04.867825 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953a7fc-7fb7-445a-af44-1996aa1a3571 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:04.992735 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:05.013203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953a7fc-7fb7-445a-af44-1996aa1a3571 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:05.064017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e445d3-3114-4612-9985-3864bbf1788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:05.065099 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e445d3-3114-4612-9985-3864bbf1788b None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:05.065651 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e445d3-3114-4612-9985-3864bbf1788b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:05.066412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e445d3-3114-4612-9985-3864bbf1788b None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970/users/7e1529b22b0646a081a928132b1b9f5e/roles/1b3ca57e3e474fc79fac8dc29aedc036` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:05.068975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e445d3-3114-4612-9985-3864bbf1788b None admin] RBAC: Authorizing `identity:create_grant(project_id=2a06dab7f53d450b855338d052303970, user_id=7e1529b22b0646a081a928132b1b9f5e, role_id=1b3ca57e3e474fc79fac8dc29aedc036)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:05.070776 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e445d3-3114-4612-9985-3864bbf1788b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:05.091599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 143/286] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:52:04 2022] PUT /identity/v3/projects/2a06dab7f53d450b855338d052303970/users/7e1529b22b0646a081a928132b1b9f5e/roles/1b3ca57e3e474fc79fac8dc29aedc036 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:05.308232 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a0b18-98b6-45d0-bded-d093d26ba3bc None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:05.308708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a0b18-98b6-45d0-bded-d093d26ba3bc None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:05.308708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a0b18-98b6-45d0-bded-d093d26ba3bc None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:05.310376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 144/287] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:05.316505 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2de0a-89e9-4ef6-b77e-92ffaf0d48c9 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:05.316801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2de0a-89e9-4ef6-b77e-92ffaf0d48c9 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:05.317083 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2de0a-89e9-4ef6-b77e-92ffaf0d48c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:05.337394 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-50b2de0a-89e9-4ef6-b77e-92ffaf0d48c9 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:05.338626 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-50b2de0a-89e9-4ef6-b77e-92ffaf0d48c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:05.429985 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 144/288] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:05.467722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a0b18-98b6-45d0-bded-d093d26ba3bc None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:05.608388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a0b18-98b6-45d0-bded-d093d26ba3bc None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:05.645597 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05f5b8-9e10-4949-9727-cdc907f4d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:05.646250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05f5b8-9e10-4949-9727-cdc907f4d072 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:05.646553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05f5b8-9e10-4949-9727-cdc907f4d072 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:05.646838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05f5b8-9e10-4949-9727-cdc907f4d072 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:05.658671 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05f5b8-9e10-4949-9727-cdc907f4d072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-fa05f5b8-9e10-4949-9727-cdc907f4d072 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:05.664504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:05.665382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:05.666178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 145/289] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:05.673872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2de0a-89e9-4ef6-b77e-92ffaf0d48c9 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:05.771860 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:05.787467 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2de0a-89e9-4ef6-b77e-92ffaf0d48c9 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:05.835845 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c60443-d788-4bb5-b447-5ada92b23e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:05.836484 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c60443-d788-4bb5-b447-5ada92b23e5b None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:05.836769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c60443-d788-4bb5-b447-5ada92b23e5b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:05.837044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c60443-d788-4bb5-b447-5ada92b23e5b None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:05.837767 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c60443-d788-4bb5-b447-5ada92b23e5b None admin] RBAC: Adding query filter params (name=member) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:05.838074 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c60443-d788-4bb5-b447-5ada92b23e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:05.839484 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c60443-d788-4bb5-b447-5ada92b23e5b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:05.853359 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 145/290] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:05.859250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05f5b8-9e10-4949-9727-cdc907f4d072 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:05.916254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:05.966436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05f5b8-9e10-4949-9727-cdc907f4d072 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:06.004002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638717-512c-4586-83a4-71c7e90fe9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:06.004658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638717-512c-4586-83a4-71c7e90fe9de None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:06.004941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638717-512c-4586-83a4-71c7e90fe9de None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:06.005218 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638717-512c-4586-83a4-71c7e90fe9de None admin] PATH_INFO: `/v3/users/ce05adea5b0f477da06d805a911f32ff` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:06.006477 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2638717-512c-4586-83a4-71c7e90fe9de None admin] RBAC: Authorizing `identity:get_user(user_id=ce05adea5b0f477da06d805a911f32ff)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:06.007953 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2638717-512c-4586-83a4-71c7e90fe9de None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:06.009902 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 146/291] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:05 2022] GET /identity/v3/users/ce05adea5b0f477da06d805a911f32ff => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:06.015553 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c60443-d788-4bb5-b447-5ada92b23e5b None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:06.152071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c60443-d788-4bb5-b447-5ada92b23e5b None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:06.206052 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c9341-89df-4a1d-a78e-1d79f1e79656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:06.206780 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9341-89df-4a1d-a78e-1d79f1e79656 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:06.207067 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9341-89df-4a1d-a78e-1d79f1e79656 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:06.207349 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9341-89df-4a1d-a78e-1d79f1e79656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:06.224281 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:06.314182 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c9341-89df-4a1d-a78e-1d79f1e79656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:06.316154 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c9341-89df-4a1d-a78e-1d79f1e79656 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:06.457672 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 146/292] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:06.463234 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638717-512c-4586-83a4-71c7e90fe9de None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:06.575683 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638717-512c-4586-83a4-71c7e90fe9de None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:06.603573 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:06.613815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec7216-1b63-48d3-9bb0-044e56503cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:06.614711 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec7216-1b63-48d3-9bb0-044e56503cd9 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:06.615000 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec7216-1b63-48d3-9bb0-044e56503cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:06.615344 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec7216-1b63-48d3-9bb0-044e56503cd9 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:06.616621 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec7216-1b63-48d3-9bb0-044e56503cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:06.618078 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec7216-1b63-48d3-9bb0-044e56503cd9 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:06.620181 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 147/293] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:06 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:06.625848 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c9341-89df-4a1d-a78e-1d79f1e79656 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:06.670847 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:06.756060 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c9341-89df-4a1d-a78e-1d79f1e79656 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:06.804972 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118a2eb-35f9-4d30-a855-b34c2b355310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:06.805602 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118a2eb-35f9-4d30-a855-b34c2b355310 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:06.805882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118a2eb-35f9-4d30-a855-b34c2b355310 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:06.806213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118a2eb-35f9-4d30-a855-b34c2b355310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:06.807099 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118a2eb-35f9-4d30-a855-b34c2b355310 None admin] RBAC: Adding query filter params (role.id=a2eb0e476c1f497888d73bb1d1771d16, scope.project.id=2a06dab7f53d450b855338d052303970, user.id=ce05adea5b0f477da06d805a911f32ff) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:06.807464 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118a2eb-35f9-4d30-a855-b34c2b355310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:06.808905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118a2eb-35f9-4d30-a855-b34c2b355310 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:06.816647 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 147/294] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:06 2022] GET /identity/v3/role_assignments?user.id=ce05adea5b0f477da06d805a911f32ff&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:06.920882 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5820ae-907e-476a-9513-1de63d42101e None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:06.921171 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5820ae-907e-476a-9513-1de63d42101e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:06.921458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5820ae-907e-476a-9513-1de63d42101e None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:06.923772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 148/295] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:06.929576 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817464a7-3863-4cab-af10-4a25b3c3b8aa None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:06.929913 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817464a7-3863-4cab-af10-4a25b3c3b8aa None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:06.930138 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817464a7-3863-4cab-af10-4a25b3c3b8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:06.954801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-817464a7-3863-4cab-af10-4a25b3c3b8aa None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:06.956542 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-817464a7-3863-4cab-af10-4a25b3c3b8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:07.073445 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 148/296] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:07.100125 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5820ae-907e-476a-9513-1de63d42101e None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:07.105030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669010-a54f-42af-9e04-d6f40bb8961a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:07.106487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669010-a54f-42af-9e04-d6f40bb8961a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:07.107146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669010-a54f-42af-9e04-d6f40bb8961a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:07.108849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 149/297] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:07.120468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e71aef-e93e-4ea2-8f36-559453cc683c None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:07.121141 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e71aef-e93e-4ea2-8f36-559453cc683c None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:07.121599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e71aef-e93e-4ea2-8f36-559453cc683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:07.148681 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-07e71aef-e93e-4ea2-8f36-559453cc683c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:07.150477 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-07e71aef-e93e-4ea2-8f36-559453cc683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:07.185368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:07.224675 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5820ae-907e-476a-9513-1de63d42101e None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:07.250658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 150/298] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:07.271302 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e71aef-e93e-4ea2-8f36-559453cc683c None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:07.272238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08578c2c-58b6-42a3-9159-6c494ae9fab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:07.273119 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08578c2c-58b6-42a3-9159-6c494ae9fab0 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:07.274140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08578c2c-58b6-42a3-9159-6c494ae9fab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:07.274659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08578c2c-58b6-42a3-9159-6c494ae9fab0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:07.277056 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08578c2c-58b6-42a3-9159-6c494ae9fab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:07.278745 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08578c2c-58b6-42a3-9159-6c494ae9fab0 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:07.281398 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 149/299] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:07.292465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08578c2c-58b6-42a3-9159-6c494ae9fab0 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:07.379154 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:07.420163 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e71aef-e93e-4ea2-8f36-559453cc683c None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:07.445564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08578c2c-58b6-42a3-9159-6c494ae9fab0 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:07.468540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586f4f5-5080-412e-a912-5bf585733688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:07.469607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586f4f5-5080-412e-a912-5bf585733688 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:07.470340 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586f4f5-5080-412e-a912-5bf585733688 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:07.470914 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586f4f5-5080-412e-a912-5bf585733688 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:07.482363 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586f4f5-5080-412e-a912-5bf585733688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:07.483478 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af7bf2-03cc-499f-8d93-ea8408311a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:07.484117 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af7bf2-03cc-499f-8d93-ea8408311a2f None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:07.484457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af7bf2-03cc-499f-8d93-ea8408311a2f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:07.484741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af7bf2-03cc-499f-8d93-ea8408311a2f None admin] PATH_INFO: `/v3/groups` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:07.485953 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af7bf2-03cc-499f-8d93-ea8408311a2f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:07.487430 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af7bf2-03cc-499f-8d93-ea8408311a2f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-8586f4f5-5080-412e-a912-5bf585733688 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:07.490722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:07.491605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:52:07.492413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:07.493014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 151/300] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:07.497804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ffaff-4736-4c9f-8b59-d04144c04297 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:07.497804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ffaff-4736-4c9f-8b59-d04144c04297 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:07.497804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ffaff-4736-4c9f-8b59-d04144c04297 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:07.497804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 152/301] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:07.500467 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ffaff-4736-4c9f-8b59-d04144c04297 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:07.508948 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 150/302] 10.222.0.73 () {60 vars in 1134 bytes} [Wed Jul 27 17:52:07 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:52:07.510575 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf62749-186c-4672-8991-3a6b8c813bb2 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:07.510990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf62749-186c-4672-8991-3a6b8c813bb2 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:07.511520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf62749-186c-4672-8991-3a6b8c813bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:07.531352 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:07.534396 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-eaf62749-186c-4672-8991-3a6b8c813bb2 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:07.536010 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-eaf62749-186c-4672-8991-3a6b8c813bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:07.624144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ffaff-4736-4c9f-8b59-d04144c04297 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:07.640103 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 151/303] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:07.665575 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf62749-186c-4672-8991-3a6b8c813bb2 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:07.676896 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087d30e-35bc-4871-992e-36daf512490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:07.677537 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087d30e-35bc-4871-992e-36daf512490d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:07.677821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087d30e-35bc-4871-992e-36daf512490d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:07.678157 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087d30e-35bc-4871-992e-36daf512490d None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:07.678939 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087d30e-35bc-4871-992e-36daf512490d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:07.679302 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087d30e-35bc-4871-992e-36daf512490d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:07.680785 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087d30e-35bc-4871-992e-36daf512490d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:07.691516 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 153/304] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:07.697264 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087d30e-35bc-4871-992e-36daf512490d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:07.729161 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:07.804631 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf62749-186c-4672-8991-3a6b8c813bb2 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:07.835280 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:07.843324 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92680519-304f-488c-9bf5-759dd5168b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:07.844243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92680519-304f-488c-9bf5-759dd5168b28 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:07.844373 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92680519-304f-488c-9bf5-759dd5168b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:07.845148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92680519-304f-488c-9bf5-759dd5168b28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:07.856998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92680519-304f-488c-9bf5-759dd5168b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:07.858477 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087d30e-35bc-4871-992e-36daf512490d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-92680519-304f-488c-9bf5-759dd5168b28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:07.862323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:07.863261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:07.864618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 152/305] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:07.869704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92680519-304f-488c-9bf5-759dd5168b28 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:07.915376 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2114b-6283-4d6b-80ad-cffa60843da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:07.916423 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2114b-6283-4d6b-80ad-cffa60843da8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:07.917191 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2114b-6283-4d6b-80ad-cffa60843da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:07.918730 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2114b-6283-4d6b-80ad-cffa60843da8 None admin] PATH_INFO: `/v3/users/37aecc8547b44c54bab89e48cbefe4f1` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:07.947580 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2114b-6283-4d6b-80ad-cffa60843da8 None admin] RBAC: Authorizing `identity:get_user(user_id=37aecc8547b44c54bab89e48cbefe4f1)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:07.950299 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2114b-6283-4d6b-80ad-cffa60843da8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:07.958254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 154/306] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:07 2022] GET /identity/v3/users/37aecc8547b44c54bab89e48cbefe4f1 => generated 293 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:07.960015 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2114b-6283-4d6b-80ad-cffa60843da8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:07.996624 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92680519-304f-488c-9bf5-759dd5168b28 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:08.005443 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:08.036226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3a9c5-c791-40e6-9d0f-d7498f4aace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:08.037140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3a9c5-c791-40e6-9d0f-d7498f4aace9 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:08.037274 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3a9c5-c791-40e6-9d0f-d7498f4aace9 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:08.037599 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3a9c5-c791-40e6-9d0f-d7498f4aace9 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:08.038402 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3a9c5-c791-40e6-9d0f-d7498f4aace9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:08.038901 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3a9c5-c791-40e6-9d0f-d7498f4aace9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:08.040317 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3a9c5-c791-40e6-9d0f-d7498f4aace9 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:08.056747 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 153/307] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:08.056934 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3a9c5-c791-40e6-9d0f-d7498f4aace9 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:08.078926 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2114b-6283-4d6b-80ad-cffa60843da8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:08.118786 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421aec9-0a54-43ba-9132-299ca67b8c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:08.119413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421aec9-0a54-43ba-9132-299ca67b8c53 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:08.119722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421aec9-0a54-43ba-9132-299ca67b8c53 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:08.120008 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421aec9-0a54-43ba-9132-299ca67b8c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:08.120793 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421aec9-0a54-43ba-9132-299ca67b8c53 None admin] RBAC: Adding query filter params (role.id=1b3ca57e3e474fc79fac8dc29aedc036, user.id=37aecc8547b44c54bab89e48cbefe4f1, scope.system=all) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:08.121102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421aec9-0a54-43ba-9132-299ca67b8c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:08.122540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421aec9-0a54-43ba-9132-299ca67b8c53 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:08.128886 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 155/308] 10.222.0.73 () {56 vars in 1308 bytes} [Wed Jul 27 17:52:07 2022] GET /identity/v3/role_assignments?user.id=37aecc8547b44c54bab89e48cbefe4f1&scope.system=all&role.id=1b3ca57e3e474fc79fac8dc29aedc036 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:08.132354 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7ab09-24cc-4dd6-b94c-8eb96fdcea99 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:08.132639 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7ab09-24cc-4dd6-b94c-8eb96fdcea99 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:08.132907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7ab09-24cc-4dd6-b94c-8eb96fdcea99 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:08.134492 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 156/309] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:08.140637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860868db-d809-4a8e-807c-33960089676a None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:08.140637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860868db-d809-4a8e-807c-33960089676a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:08.140882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860868db-d809-4a8e-807c-33960089676a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:08.161674 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-860868db-d809-4a8e-807c-33960089676a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:08.162966 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-860868db-d809-4a8e-807c-33960089676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:08.165362 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:08.179894 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3a9c5-c791-40e6-9d0f-d7498f4aace9 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:08.221519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83964c9-4512-4849-a53c-7d92aa834288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:08.222644 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83964c9-4512-4849-a53c-7d92aa834288 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:08.223181 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83964c9-4512-4849-a53c-7d92aa834288 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:08.223942 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83964c9-4512-4849-a53c-7d92aa834288 None admin] PATH_INFO: `/v3/users/031027bdd22a46149c56ef40a5758bf5` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:08.225718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83964c9-4512-4849-a53c-7d92aa834288 None admin] RBAC: Authorizing `identity:get_user(user_id=031027bdd22a46149c56ef40a5758bf5)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:08.227509 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83964c9-4512-4849-a53c-7d92aa834288 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:08.234632 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 154/310] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:08 2022] GET /identity/v3/users/031027bdd22a46149c56ef40a5758bf5 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:08.236552 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83964c9-4512-4849-a53c-7d92aa834288 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:08.244901 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 157/311] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:08.270642 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860868db-d809-4a8e-807c-33960089676a None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:08.278262 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:08.351175 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83964c9-4512-4849-a53c-7d92aa834288 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:08.386488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa9bdb-98e4-41e2-8ad6-4eaaf51e56f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:08.387208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa9bdb-98e4-41e2-8ad6-4eaaf51e56f9 None admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:08.387492 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa9bdb-98e4-41e2-8ad6-4eaaf51e56f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:08.387771 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa9bdb-98e4-41e2-8ad6-4eaaf51e56f9 None admin] PATH_INFO: `/v3/system/users/031027bdd22a46149c56ef40a5758bf5/roles/a2eb0e476c1f497888d73bb1d1771d16` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:08.388659 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860868db-d809-4a8e-807c-33960089676a None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:08.389243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa9bdb-98e4-41e2-8ad6-4eaaf51e56f9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=031027bdd22a46149c56ef40a5758bf5, role_id=a2eb0e476c1f497888d73bb1d1771d16)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:08.390641 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa9bdb-98e4-41e2-8ad6-4eaaf51e56f9 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:08.402940 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 155/312] 10.222.0.73 () {58 vars in 1334 bytes} [Wed Jul 27 17:52:08 2022] PUT /identity/v3/system/users/031027bdd22a46149c56ef40a5758bf5/roles/a2eb0e476c1f497888d73bb1d1771d16 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:08.430714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fadd5-aa56-40c9-ba73-19efe3bdd484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:08.431762 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fadd5-aa56-40c9-ba73-19efe3bdd484 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:08.432250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fadd5-aa56-40c9-ba73-19efe3bdd484 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:08.432740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fadd5-aa56-40c9-ba73-19efe3bdd484 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:08.446096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fadd5-aa56-40c9-ba73-19efe3bdd484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-f80fadd5-aa56-40c9-ba73-19efe3bdd484 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:08.451611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:08.452559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:52:08.453360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:08.457040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:08.462137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 158/313] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:08.462908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa9bdb-98e4-41e2-8ad6-4eaaf51e56f9 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:08.580686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa9bdb-98e4-41e2-8ad6-4eaaf51e56f9 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:08.589247 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:08.620868 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fba23c-0a6a-4b29-8f7f-984e4e2565e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:08.621547 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fba23c-0a6a-4b29-8f7f-984e4e2565e4 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:08.621834 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fba23c-0a6a-4b29-8f7f-984e4e2565e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:08.622112 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fba23c-0a6a-4b29-8f7f-984e4e2565e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:08.622870 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fba23c-0a6a-4b29-8f7f-984e4e2565e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:08.623178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fba23c-0a6a-4b29-8f7f-984e4e2565e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:08.624563 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fba23c-0a6a-4b29-8f7f-984e4e2565e4 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:08.633636 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 156/314] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:08.639549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fadd5-aa56-40c9-ba73-19efe3bdd484 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:08.751092 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fadd5-aa56-40c9-ba73-19efe3bdd484 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:08.788454 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d049-01a6-4a0c-aa04-35ee7daf8a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:08.789166 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d049-01a6-4a0c-aa04-35ee7daf8a67 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:08.789444 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d049-01a6-4a0c-aa04-35ee7daf8a67 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:08.789714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d049-01a6-4a0c-aa04-35ee7daf8a67 None admin] PATH_INFO: `/v3/users/7e1529b22b0646a081a928132b1b9f5e` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:08.790959 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251d049-01a6-4a0c-aa04-35ee7daf8a67 None admin] RBAC: Authorizing `identity:get_user(user_id=7e1529b22b0646a081a928132b1b9f5e)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:08.792398 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251d049-01a6-4a0c-aa04-35ee7daf8a67 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:08.794418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 159/315] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:08 2022] GET /identity/v3/users/7e1529b22b0646a081a928132b1b9f5e => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:08.800195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fba23c-0a6a-4b29-8f7f-984e4e2565e4 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:08.917800 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fba23c-0a6a-4b29-8f7f-984e4e2565e4 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:08.954252 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029813d-1fe8-4683-9a71-b0c75deaedfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:08.955060 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029813d-1fe8-4683-9a71-b0c75deaedfb None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:08.955345 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029813d-1fe8-4683-9a71-b0c75deaedfb None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:08.955627 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029813d-1fe8-4683-9a71-b0c75deaedfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:08.987575 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:09.026392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029813d-1fe8-4683-9a71-b0c75deaedfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:09.027809 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029813d-1fe8-4683-9a71-b0c75deaedfb None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:09.129614 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 157/316] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:09.135149 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d049-01a6-4a0c-aa04-35ee7daf8a67 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:09.205061 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:09.243849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d049-01a6-4a0c-aa04-35ee7daf8a67 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:09.279923 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ce24a-ec3d-4c46-b4dd-eb416230099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:09.280500 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce24a-ec3d-4c46-b4dd-eb416230099a None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:09.280783 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce24a-ec3d-4c46-b4dd-eb416230099a None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:09.281060 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce24a-ec3d-4c46-b4dd-eb416230099a None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:09.282785 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ce24a-ec3d-4c46-b4dd-eb416230099a None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:09.284228 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ce24a-ec3d-4c46-b4dd-eb416230099a None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:09.286228 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 160/317] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:09 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:09.292005 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029813d-1fe8-4683-9a71-b0c75deaedfb None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:09.362531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:09.403776 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029813d-1fe8-4683-9a71-b0c75deaedfb None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:09.439292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899d907-273a-43f7-a570-08fa6010407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:09.439925 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899d907-273a-43f7-a570-08fa6010407f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:09.440207 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899d907-273a-43f7-a570-08fa6010407f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:09.440485 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899d907-273a-43f7-a570-08fa6010407f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:09.441281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899d907-273a-43f7-a570-08fa6010407f None admin] RBAC: Adding query filter params (role.id=1b3ca57e3e474fc79fac8dc29aedc036, scope.project.id=2a06dab7f53d450b855338d052303970, user.id=7e1529b22b0646a081a928132b1b9f5e) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:09.441591 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899d907-273a-43f7-a570-08fa6010407f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:09.443059 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899d907-273a-43f7-a570-08fa6010407f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:09.449410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 158/318] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:09 2022] GET /identity/v3/role_assignments?user.id=7e1529b22b0646a081a928132b1b9f5e&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=1b3ca57e3e474fc79fac8dc29aedc036 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:09.977433 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb25e6-ce3a-4b24-9dd3-25aa752ed7b6 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:09.977832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb25e6-ce3a-4b24-9dd3-25aa752ed7b6 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:09.978041 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb25e6-ce3a-4b24-9dd3-25aa752ed7b6 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:09.979731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 161/319] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:09.984494 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16571ba7-96a1-41ad-96bd-4a2fbae5149c None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:09.984930 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16571ba7-96a1-41ad-96bd-4a2fbae5149c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:09.985108 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16571ba7-96a1-41ad-96bd-4a2fbae5149c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:10.003718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-16571ba7-96a1-41ad-96bd-4a2fbae5149c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:10.004933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-16571ba7-96a1-41ad-96bd-4a2fbae5149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:10.080348 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 159/320] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:10.103483 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb25e6-ce3a-4b24-9dd3-25aa752ed7b6 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:10.208287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb25e6-ce3a-4b24-9dd3-25aa752ed7b6 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:10.243102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84229181-40b3-4f3c-96a4-32d55a4e2156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:10.243757 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84229181-40b3-4f3c-96a4-32d55a4e2156 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:10.244042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84229181-40b3-4f3c-96a4-32d55a4e2156 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:10.244322 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84229181-40b3-4f3c-96a4-32d55a4e2156 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:10.245468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84229181-40b3-4f3c-96a4-32d55a4e2156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:10.246960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84229181-40b3-4f3c-96a4-32d55a4e2156 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:10.248736 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 162/321] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:10.254474 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16571ba7-96a1-41ad-96bd-4a2fbae5149c None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:10.314832 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:10.364025 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16571ba7-96a1-41ad-96bd-4a2fbae5149c None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:10.398996 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4457efb-b269-4a44-813a-a7e897f27a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:10.399884 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457efb-b269-4a44-813a-a7e897f27a8f None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:10.400165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457efb-b269-4a44-813a-a7e897f27a8f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:10.400443 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457efb-b269-4a44-813a-a7e897f27a8f None admin] PATH_INFO: `/v3/groups` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:10.401103 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4457efb-b269-4a44-813a-a7e897f27a8f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:10.402569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4457efb-b269-4a44-813a-a7e897f27a8f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:10.423194 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 160/322] 10.222.0.73 () {60 vars in 1134 bytes} [Wed Jul 27 17:52:10 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:52:10.477917 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d54421-0da1-42cd-bc4d-37c9d6d363be None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:10.478188 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d54421-0da1-42cd-bc4d-37c9d6d363be None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:10.478469 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d54421-0da1-42cd-bc4d-37c9d6d363be None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:10.480100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 163/323] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:10.486019 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eea4dc-cd39-4819-ad81-23c70d4eabf4 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:10.486391 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eea4dc-cd39-4819-ad81-23c70d4eabf4 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:10.486696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eea4dc-cd39-4819-ad81-23c70d4eabf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:10.507059 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-92eea4dc-cd39-4819-ad81-23c70d4eabf4 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:10.508281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-92eea4dc-cd39-4819-ad81-23c70d4eabf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:10.594535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 161/324] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:10.614186 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d54421-0da1-42cd-bc4d-37c9d6d363be None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:10.617196 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:10.729138 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d54421-0da1-42cd-bc4d-37c9d6d363be None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:10.772978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dc99a-d312-46b9-8bb7-880c05becfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:10.773688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dc99a-d312-46b9-8bb7-880c05becfb7 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:10.773975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dc99a-d312-46b9-8bb7-880c05becfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:10.774604 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dc99a-d312-46b9-8bb7-880c05becfb7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:10.787809 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dc99a-d312-46b9-8bb7-880c05becfb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-916dc99a-d312-46b9-8bb7-880c05becfb7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:10.793314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:10.794223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:10.795053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 164/325] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:10.802554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eea4dc-cd39-4819-ad81-23c70d4eabf4 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:10.829139 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e1909-6d2e-4c45-bb5b-053c54b65b7a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:10.830005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e1909-6d2e-4c45-bb5b-053c54b65b7a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:10.830477 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e1909-6d2e-4c45-bb5b-053c54b65b7a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:10.832156 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 165/326] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:10.841082 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3a43-fc8e-491a-9907-160c554ec613 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:10.841082 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3a43-fc8e-491a-9907-160c554ec613 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:10.841082 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3a43-fc8e-491a-9907-160c554ec613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:10.858058 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-9c0f3a43-fc8e-491a-9907-160c554ec613 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:10.859442 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-9c0f3a43-fc8e-491a-9907-160c554ec613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:10.859600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:10.932141 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:10.934832 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eea4dc-cd39-4819-ad81-23c70d4eabf4 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:10.947245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 166/327] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:10.982547 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f3a43-fc8e-491a-9907-160c554ec613 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:10.994113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a34be-91a6-4e99-a5bc-35785d0d1a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:10.995478 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a34be-91a6-4e99-a5bc-35785d0d1a80 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:10.995904 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a34be-91a6-4e99-a5bc-35785d0d1a80 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:10.996365 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a34be-91a6-4e99-a5bc-35785d0d1a80 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:10.997690 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a34be-91a6-4e99-a5bc-35785d0d1a80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:10.998661 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a34be-91a6-4e99-a5bc-35785d0d1a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:11.000543 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a34be-91a6-4e99-a5bc-35785d0d1a80 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:11.012932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 162/328] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:11.019290 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a34be-91a6-4e99-a5bc-35785d0d1a80 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:11.111645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f3a43-fc8e-491a-9907-160c554ec613 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:11.127819 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a34be-91a6-4e99-a5bc-35785d0d1a80 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:11.137410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:11.152459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5d7c9-5b09-4e1c-9879-2232e3f2ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:11.153448 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5d7c9-5b09-4e1c-9879-2232e3f2ccee None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:11.153882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5d7c9-5b09-4e1c-9879-2232e3f2ccee None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:11.154356 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5d7c9-5b09-4e1c-9879-2232e3f2ccee None admin] PATH_INFO: `/v3/roles/member` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:11.166429 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8d46-0dbf-4d11-a577-03f22383bfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:11.167197 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8d46-0dbf-4d11-a577-03f22383bfee None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:11.167438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8d46-0dbf-4d11-a577-03f22383bfee None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:11.167715 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8d46-0dbf-4d11-a577-03f22383bfee None admin] PATH_INFO: `/v3/users/37aecc8547b44c54bab89e48cbefe4f1` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:11.168164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5d7c9-5b09-4e1c-9879-2232e3f2ccee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:11.168954 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed8d46-0dbf-4d11-a577-03f22383bfee None admin] RBAC: Authorizing `identity:get_user(user_id=37aecc8547b44c54bab89e48cbefe4f1)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:11.170579 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed8d46-0dbf-4d11-a577-03f22383bfee None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:11.172871 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 163/329] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:11 2022] GET /identity/v3/users/37aecc8547b44c54bab89e48cbefe4f1 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-bee5d7c9-5b09-4e1c-9879-2232e3f2ccee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:11.174953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:11.176031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:11.177118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:11.183945 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8d46-0dbf-4d11-a577-03f22383bfee None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:11.184086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 167/330] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:11.185359 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5d7c9-5b09-4e1c-9879-2232e3f2ccee None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:11.246042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:11.299799 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8d46-0dbf-4d11-a577-03f22383bfee None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:11.307017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5d7c9-5b09-4e1c-9879-2232e3f2ccee None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:11.339840 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db50acf-c8b2-495a-985f-52b99fc92f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:11.340518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50acf-c8b2-495a-985f-52b99fc92f4c None admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:11.340857 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50acf-c8b2-495a-985f-52b99fc92f4c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:11.341138 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50acf-c8b2-495a-985f-52b99fc92f4c None admin] PATH_INFO: `/v3/system/users/37aecc8547b44c54bab89e48cbefe4f1/roles/1b3ca57e3e474fc79fac8dc29aedc036` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:11.342884 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db50acf-c8b2-495a-985f-52b99fc92f4c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=37aecc8547b44c54bab89e48cbefe4f1, role_id=1b3ca57e3e474fc79fac8dc29aedc036)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:11.344418 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db50acf-c8b2-495a-985f-52b99fc92f4c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:11.354730 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf7e76-527e-47d8-81d6-224be1b17aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:11.355700 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf7e76-527e-47d8-81d6-224be1b17aba None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:11.356249 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf7e76-527e-47d8-81d6-224be1b17aba None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:11.356780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 164/331] 10.222.0.73 () {58 vars in 1334 bytes} [Wed Jul 27 17:52:11 2022] PUT /identity/v3/system/users/37aecc8547b44c54bab89e48cbefe4f1/roles/1b3ca57e3e474fc79fac8dc29aedc036 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:11.356987 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf7e76-527e-47d8-81d6-224be1b17aba None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:11.357991 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf7e76-527e-47d8-81d6-224be1b17aba None admin] RBAC: Adding query filter params (name=member) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:11.358449 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf7e76-527e-47d8-81d6-224be1b17aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:11.360158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf7e76-527e-47d8-81d6-224be1b17aba None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:11.378664 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 168/332] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:11.381267 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db50acf-c8b2-495a-985f-52b99fc92f4c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:11.433576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:11.509571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db50acf-c8b2-495a-985f-52b99fc92f4c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:11.550438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcb023-7d22-4f8d-8738-6ee61a26fa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:11.551432 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcb023-7d22-4f8d-8738-6ee61a26fa87 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:11.551870 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcb023-7d22-4f8d-8738-6ee61a26fa87 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:11.552299 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcb023-7d22-4f8d-8738-6ee61a26fa87 None admin] PATH_INFO: `/v3/users/031027bdd22a46149c56ef40a5758bf5` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:11.553799 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcb023-7d22-4f8d-8738-6ee61a26fa87 None admin] RBAC: Authorizing `identity:get_user(user_id=031027bdd22a46149c56ef40a5758bf5)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:11.555604 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcb023-7d22-4f8d-8738-6ee61a26fa87 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:11.562567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 165/333] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:11 2022] GET /identity/v3/users/031027bdd22a46149c56ef40a5758bf5 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:11.565653 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf7e76-527e-47d8-81d6-224be1b17aba None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:11.680450 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf7e76-527e-47d8-81d6-224be1b17aba None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:11.695567 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:11.719500 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c80c0-eb09-4cb7-9689-5418db75b391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:11.720162 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c80c0-eb09-4cb7-9689-5418db75b391 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:11.720446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c80c0-eb09-4cb7-9689-5418db75b391 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:11.720725 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c80c0-eb09-4cb7-9689-5418db75b391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:11.721522 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c80c0-eb09-4cb7-9689-5418db75b391 None admin] RBAC: Adding query filter params (role.id=a2eb0e476c1f497888d73bb1d1771d16, user.id=031027bdd22a46149c56ef40a5758bf5, scope.system=all) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:11.721836 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c80c0-eb09-4cb7-9689-5418db75b391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:11.723334 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c80c0-eb09-4cb7-9689-5418db75b391 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:11.740372 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 169/334] 10.222.0.73 () {56 vars in 1308 bytes} [Wed Jul 27 17:52:11 2022] GET /identity/v3/role_assignments?user.id=031027bdd22a46149c56ef40a5758bf5&scope.system=all&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:13.318535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa322-2a56-4464-b802-caf8aa529465 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:13.319152 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa322-2a56-4464-b802-caf8aa529465 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:13.320079 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa322-2a56-4464-b802-caf8aa529465 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:13.321774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 166/335] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:13.327417 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e626ec7-509c-40c1-b048-ffb21d703844 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:13.327940 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e626ec7-509c-40c1-b048-ffb21d703844 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:13.328022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e626ec7-509c-40c1-b048-ffb21d703844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:13.352799 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-2e626ec7-509c-40c1-b048-ffb21d703844 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:13.354030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-2e626ec7-509c-40c1-b048-ffb21d703844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:13.437410 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 170/336] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:13.465277 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e834a1-f8b9-469c-9c76-4668a938d20b None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:13.465598 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e834a1-f8b9-469c-9c76-4668a938d20b None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:13.465837 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e834a1-f8b9-469c-9c76-4668a938d20b None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:13.467225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 167/337] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:13.473574 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28f0b6-2e89-4a39-a98a-1203fd1dbbab None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:13.473872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28f0b6-2e89-4a39-a98a-1203fd1dbbab None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:13.474160 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28f0b6-2e89-4a39-a98a-1203fd1dbbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:13.477805 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e834a1-f8b9-469c-9c76-4668a938d20b None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:13.497329 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-ad28f0b6-2e89-4a39-a98a-1203fd1dbbab None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:13.499234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-ad28f0b6-2e89-4a39-a98a-1203fd1dbbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:13.648978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 171/338] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:13.675839 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e834a1-f8b9-469c-9c76-4668a938d20b None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:13.689154 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:13.726014 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da8dff-afce-4111-a6ed-1b819ed07d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:13.726697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da8dff-afce-4111-a6ed-1b819ed07d6d None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:13.726984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da8dff-afce-4111-a6ed-1b819ed07d6d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:13.727264 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da8dff-afce-4111-a6ed-1b819ed07d6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:13.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da8dff-afce-4111-a6ed-1b819ed07d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-92da8dff-afce-4111-a6ed-1b819ed07d6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:13.751775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:13.753259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:13.754179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 168/339] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:13.758682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28f0b6-2e89-4a39-a98a-1203fd1dbbab None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:13.778721 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da8dff-afce-4111-a6ed-1b819ed07d6d None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:13.835666 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:13.978992 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da8dff-afce-4111-a6ed-1b819ed07d6d None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:14.002772 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28f0b6-2e89-4a39-a98a-1203fd1dbbab None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:14.026733 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06fe5a-d8df-456a-a661-469750e6fcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:14.027742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06fe5a-d8df-456a-a661-469750e6fcd6 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:14.028226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06fe5a-d8df-456a-a661-469750e6fcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:14.028703 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06fe5a-d8df-456a-a661-469750e6fcd6 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:14.029635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06fe5a-d8df-456a-a661-469750e6fcd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:14.030159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06fe5a-d8df-456a-a661-469750e6fcd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:14.035866 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06fe5a-d8df-456a-a661-469750e6fcd6 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:14.053201 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 169/340] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:14.059320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06fe5a-d8df-456a-a661-469750e6fcd6 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:14.059790 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3b1e7-3168-4dfe-a36c-132a71eb98f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:14.060470 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3b1e7-3168-4dfe-a36c-132a71eb98f9 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:14.060764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3b1e7-3168-4dfe-a36c-132a71eb98f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:14.061047 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3b1e7-3168-4dfe-a36c-132a71eb98f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:14.088097 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3b1e7-3168-4dfe-a36c-132a71eb98f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-5fd3b1e7-3168-4dfe-a36c-132a71eb98f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:14.093147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:14.094064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:14.099728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 172/341] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:52:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:14.107574 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3b1e7-3168-4dfe-a36c-132a71eb98f9 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:14.108381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:14.202812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06fe5a-d8df-456a-a661-469750e6fcd6 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:14.237088 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:14.249999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bc074-5e06-4f15-92ec-3cd3d528c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:14.252841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3b1e7-3168-4dfe-a36c-132a71eb98f9 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:14.253703 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bc074-5e06-4f15-92ec-3cd3d528c303 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:14.254216 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bc074-5e06-4f15-92ec-3cd3d528c303 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:14.254732 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bc074-5e06-4f15-92ec-3cd3d528c303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:14.331285 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdd6fb-64ce-4a8d-a5a9-3d96575aeae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:14.332016 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdd6fb-64ce-4a8d-a5a9-3d96575aeae3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:14.332227 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdd6fb-64ce-4a8d-a5a9-3d96575aeae3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:14.332512 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdd6fb-64ce-4a8d-a5a9-3d96575aeae3 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:14.333355 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdd6fb-64ce-4a8d-a5a9-3d96575aeae3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:14.333568 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdd6fb-64ce-4a8d-a5a9-3d96575aeae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:14.335019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdd6fb-64ce-4a8d-a5a9-3d96575aeae3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:14.346919 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 173/342] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:14.352230 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdd6fb-64ce-4a8d-a5a9-3d96575aeae3 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:14.364209 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bc074-5e06-4f15-92ec-3cd3d528c303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:14.366769 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bc074-5e06-4f15-92ec-3cd3d528c303 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:14.404594 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:14.487329 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 170/343] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 17:52:14.492506 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bc074-5e06-4f15-92ec-3cd3d528c303 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:14.578054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdd6fb-64ce-4a8d-a5a9-3d96575aeae3 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:14.628799 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fd16a-f831-46f9-be73-21890761e164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:14.629890 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fd16a-f831-46f9-be73-21890761e164 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:14.630483 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fd16a-f831-46f9-be73-21890761e164 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:14.631097 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fd16a-f831-46f9-be73-21890761e164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:14.649695 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bc074-5e06-4f15-92ec-3cd3d528c303 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:14.667285 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:14.686219 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:14.696636 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880d8a9-7202-427a-8a6b-98b5d43024db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:14.697563 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880d8a9-7202-427a-8a6b-98b5d43024db None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:14.697993 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880d8a9-7202-427a-8a6b-98b5d43024db None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:14.698405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880d8a9-7202-427a-8a6b-98b5d43024db None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:14.699776 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880d8a9-7202-427a-8a6b-98b5d43024db None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:14.701546 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880d8a9-7202-427a-8a6b-98b5d43024db None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:14.703738 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 171/344] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:14 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:14.705168 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845243-ce3b-4aaf-a990-fffcda95a8a1 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:14.705605 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845243-ce3b-4aaf-a990-fffcda95a8a1 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:14.706026 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845243-ce3b-4aaf-a990-fffcda95a8a1 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:14.707450 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 172/345] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:14.708661 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45845243-ce3b-4aaf-a990-fffcda95a8a1 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:14.731800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fd16a-f831-46f9-be73-21890761e164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:14.734382 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fd16a-f831-46f9-be73-21890761e164 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:14.906698 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45845243-ce3b-4aaf-a990-fffcda95a8a1 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:14.935711 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 174/346] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 17:52:14.938181 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90207c41-311f-413a-b2c8-24b4975ff825 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:14.939452 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90207c41-311f-413a-b2c8-24b4975ff825 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:14.941272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90207c41-311f-413a-b2c8-24b4975ff825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:14.966531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-90207c41-311f-413a-b2c8-24b4975ff825 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:14.968082 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-90207c41-311f-413a-b2c8-24b4975ff825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:14.998454 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917c939-580b-4ddd-8c3b-3f0408fd27f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:14.999181 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c939-580b-4ddd-8c3b-3f0408fd27f4 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:14.999459 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c939-580b-4ddd-8c3b-3f0408fd27f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:14.999735 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c939-580b-4ddd-8c3b-3f0408fd27f4 None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.016360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917c939-580b-4ddd-8c3b-3f0408fd27f4 None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:15.018494 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917c939-580b-4ddd-8c3b-3f0408fd27f4 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:15.020863 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 173/347] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:14 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:15.021536 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917c939-580b-4ddd-8c3b-3f0408fd27f4 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:15.038251 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:15.051419 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 175/348] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:15.052851 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90207c41-311f-413a-b2c8-24b4975ff825 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:15.167331 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:15.179772 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90207c41-311f-413a-b2c8-24b4975ff825 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:15.210106 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917c939-580b-4ddd-8c3b-3f0408fd27f4 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:15.218599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285554b-1fb0-4101-998c-e5c0eebe85fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:15.219382 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285554b-1fb0-4101-998c-e5c0eebe85fd None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:15.219561 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285554b-1fb0-4101-998c-e5c0eebe85fd None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:15.220428 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285554b-1fb0-4101-998c-e5c0eebe85fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.221757 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285554b-1fb0-4101-998c-e5c0eebe85fd None admin] RBAC: Adding query filter params (group.id=ee750fd64f0f4b8ca42e4dfc857f7f00, role.id=a2eb0e476c1f497888d73bb1d1771d16, scope.project.id=4a43597721514990bc6b893382806592) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:15.222128 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285554b-1fb0-4101-998c-e5c0eebe85fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:15.223731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285554b-1fb0-4101-998c-e5c0eebe85fd None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:15.230011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 176/349] 10.222.0.73 () {56 vars in 1376 bytes} [Wed Jul 27 17:52:15 2022] GET /identity/v3/role_assignments?group.id=ee750fd64f0f4b8ca42e4dfc857f7f00&scope.project.id=4a43597721514990bc6b893382806592&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:15.231792 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285554b-1fb0-4101-998c-e5c0eebe85fd None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:15.252620 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dc1c1-3773-46e8-b313-48fbca362a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:15.253671 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dc1c1-3773-46e8-b313-48fbca362a13 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:15.254162 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dc1c1-3773-46e8-b313-48fbca362a13 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:15.254674 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dc1c1-3773-46e8-b313-48fbca362a13 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.256205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971dc1c1-3773-46e8-b313-48fbca362a13 None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:15.257925 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971dc1c1-3773-46e8-b313-48fbca362a13 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:15.261051 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 174/350] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:15 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:15.262707 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4bb69-6f6e-4349-ba15-55b5c96caf48 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:15.263200 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4bb69-6f6e-4349-ba15-55b5c96caf48 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:15.263668 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4bb69-6f6e-4349-ba15-55b5c96caf48 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.265489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 175/351] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:15.266444 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4bb69-6f6e-4349-ba15-55b5c96caf48 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:15.293746 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:15.359508 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285554b-1fb0-4101-998c-e5c0eebe85fd None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:15.387873 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4bb69-6f6e-4349-ba15-55b5c96caf48 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:15.402184 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0760765-f350-4e20-b986-659a78ed8f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:15.402950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0760765-f350-4e20-b986-659a78ed8f23 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:15.403274 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0760765-f350-4e20-b986-659a78ed8f23 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:15.403564 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0760765-f350-4e20-b986-659a78ed8f23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.417161 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0760765-f350-4e20-b986-659a78ed8f23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:15.422493 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-d0760765-f350-4e20-b986-659a78ed8f23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:15.425245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:15.426173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:15.427031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:15.430648 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 177/352] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:15.432180 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ae86f-8ddb-44a7-b056-d4a0f68f1e67 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:15.432469 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ae86f-8ddb-44a7-b056-d4a0f68f1e67 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:15.432745 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ae86f-8ddb-44a7-b056-d4a0f68f1e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.439411 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4713c-3ae8-46a6-8906-7fbe4a23ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:15.441598 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4713c-3ae8-46a6-8906-7fbe4a23ed69 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:15.442151 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4713c-3ae8-46a6-8906-7fbe4a23ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:15.442734 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4713c-3ae8-46a6-8906-7fbe4a23ed69 None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.444347 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4713c-3ae8-46a6-8906-7fbe4a23ed69 None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:15.447055 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4713c-3ae8-46a6-8906-7fbe4a23ed69 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:15.449618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 176/353] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:15 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:15.450714 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4713c-3ae8-46a6-8906-7fbe4a23ed69 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:15.452711 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-196ae86f-8ddb-44a7-b056-d4a0f68f1e67 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:15.453902 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-196ae86f-8ddb-44a7-b056-d4a0f68f1e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:15.551336 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 178/354] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:15.552203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ae86f-8ddb-44a7-b056-d4a0f68f1e67 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:15.603455 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4713c-3ae8-46a6-8906-7fbe4a23ed69 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:15.622132 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:15.661071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c4a2d-8458-4bb4-b8fa-dddd8e0daa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:15.661816 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c4a2d-8458-4bb4-b8fa-dddd8e0daa46 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:15.661999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c4a2d-8458-4bb4-b8fa-dddd8e0daa46 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:15.662258 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c4a2d-8458-4bb4-b8fa-dddd8e0daa46 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.663085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c4a2d-8458-4bb4-b8fa-dddd8e0daa46 None admin] RBAC: Adding query filter params (name=member) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:15.663394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c4a2d-8458-4bb4-b8fa-dddd8e0daa46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:15.664798 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c4a2d-8458-4bb4-b8fa-dddd8e0daa46 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:15.676306 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 177/355] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:15.677800 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c4a2d-8458-4bb4-b8fa-dddd8e0daa46 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:15.714746 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ae86f-8ddb-44a7-b056-d4a0f68f1e67 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:15.758065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c5fc5-8dfc-4900-a362-3f32ed7e8f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:15.759427 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c5fc5-8dfc-4900-a362-3f32ed7e8f21 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:15.760125 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c5fc5-8dfc-4900-a362-3f32ed7e8f21 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:15.760592 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c5fc5-8dfc-4900-a362-3f32ed7e8f21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.761734 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c5fc5-8dfc-4900-a362-3f32ed7e8f21 None admin] RBAC: Adding query filter params (group.id=ee750fd64f0f4b8ca42e4dfc857f7f00, role.id=4ff7ba49d92f490cba2d9ef2f9a36e79, scope.project.id=4a43597721514990bc6b893382806592) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:15.762198 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:15.762423 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c5fc5-8dfc-4900-a362-3f32ed7e8f21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:15.764920 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c5fc5-8dfc-4900-a362-3f32ed7e8f21 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:15.772821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 179/356] 10.222.0.73 () {56 vars in 1376 bytes} [Wed Jul 27 17:52:15 2022] GET /identity/v3/role_assignments?group.id=ee750fd64f0f4b8ca42e4dfc857f7f00&scope.project.id=4a43597721514990bc6b893382806592&role.id=4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:15.775523 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b462430-e7fb-4986-bf15-fecf6450a2b5 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:15.776030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b462430-e7fb-4986-bf15-fecf6450a2b5 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:15.776482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b462430-e7fb-4986-bf15-fecf6450a2b5 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.779383 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 180/357] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:15.780408 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b462430-e7fb-4986-bf15-fecf6450a2b5 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:15.831964 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c4a2d-8458-4bb4-b8fa-dddd8e0daa46 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:15.911233 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b3ce-047b-4522-b16e-6900d58a5fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:15.911819 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b3ce-047b-4522-b16e-6900d58a5fdf None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:15.912099 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b3ce-047b-4522-b16e-6900d58a5fdf None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:15.913170 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b3ce-047b-4522-b16e-6900d58a5fdf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.946898 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9b3ce-047b-4522-b16e-6900d58a5fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-14a9b3ce-047b-4522-b16e-6900d58a5fdf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:15.953919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:15.955567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:15.956518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 178/358] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:15.957712 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0261f-a53c-444f-98e0-45bb1e8c7c73 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:15.958989 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0261f-a53c-444f-98e0-45bb1e8c7c73 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:15.959281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0261f-a53c-444f-98e0-45bb1e8c7c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:15.988206 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-9ea0261f-a53c-444f-98e0-45bb1e8c7c73 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:15.989444 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-9ea0261f-a53c-444f-98e0-45bb1e8c7c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:15.997664 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b462430-e7fb-4986-bf15-fecf6450a2b5 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:15.999797 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:16.062165 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97c6b3-d633-4a71-ba33-6d291ae799f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:16.064724 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97c6b3-d633-4a71-ba33-6d291ae799f3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:16.064724 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97c6b3-d633-4a71-ba33-6d291ae799f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:16.064724 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97c6b3-d633-4a71-ba33-6d291ae799f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:16.102749 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 179/359] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:16.104146 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0261f-a53c-444f-98e0-45bb1e8c7c73 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:16.169922 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97c6b3-d633-4a71-ba33-6d291ae799f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:16.172447 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97c6b3-d633-4a71-ba33-6d291ae799f3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:16.203016 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:16.305373 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 181/360] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:16.306264 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97c6b3-d633-4a71-ba33-6d291ae799f3 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:16.308790 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:16.309905 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0261f-a53c-444f-98e0-45bb1e8c7c73 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:16.373157 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ea5a-879d-4810-8189-bb16d4b8ecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:16.374170 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ea5a-879d-4810-8189-bb16d4b8ecbe None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:16.374695 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ea5a-879d-4810-8189-bb16d4b8ecbe None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:16.375193 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ea5a-879d-4810-8189-bb16d4b8ecbe None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:16.376864 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ea5a-879d-4810-8189-bb16d4b8ecbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:16.377716 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ea5a-879d-4810-8189-bb16d4b8ecbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:16.380038 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ea5a-879d-4810-8189-bb16d4b8ecbe None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:16.406553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 180/361] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:16.408959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ea5a-879d-4810-8189-bb16d4b8ecbe None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:16.449219 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97c6b3-d633-4a71-ba33-6d291ae799f3 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:16.495641 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d5d38-24f3-4490-834d-7bcc8bdefb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:16.496314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d5d38-24f3-4490-834d-7bcc8bdefb8d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:16.496602 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d5d38-24f3-4490-834d-7bcc8bdefb8d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:16.496882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d5d38-24f3-4490-834d-7bcc8bdefb8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:16.511903 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d5d38-24f3-4490-834d-7bcc8bdefb8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-3a7d5d38-24f3-4490-834d-7bcc8bdefb8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:16.518093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:16.519731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 182/362] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:52:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:16.521232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d5d38-24f3-4490-834d-7bcc8bdefb8d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:16.628113 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:16.645077 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ea5a-879d-4810-8189-bb16d4b8ecbe None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:16.674949 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:16.697826 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d5d38-24f3-4490-834d-7bcc8bdefb8d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:16.703342 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343f876-997d-4bae-bcde-7c4f6997d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:16.704001 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343f876-997d-4bae-bcde-7c4f6997d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:16.704345 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343f876-997d-4bae-bcde-7c4f6997d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:16.704737 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343f876-997d-4bae-bcde-7c4f6997d3f6 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:16.708298 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343f876-997d-4bae-bcde-7c4f6997d3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:16.712123 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343f876-997d-4bae-bcde-7c4f6997d3f6 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:16.714052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 181/363] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:16 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:16.714946 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343f876-997d-4bae-bcde-7c4f6997d3f6 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:16.753408 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8f9fa-cbeb-41ca-b4b2-a89569e1ae7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:16.754076 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f9fa-cbeb-41ca-b4b2-a89569e1ae7b None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:16.754382 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f9fa-cbeb-41ca-b4b2-a89569e1ae7b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:16.754685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f9fa-cbeb-41ca-b4b2-a89569e1ae7b None admin] PATH_INFO: `/v3/users/37aecc8547b44c54bab89e48cbefe4f1` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:16.756094 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8f9fa-cbeb-41ca-b4b2-a89569e1ae7b None admin] RBAC: Authorizing `identity:get_user(user_id=37aecc8547b44c54bab89e48cbefe4f1)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:16.757566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8f9fa-cbeb-41ca-b4b2-a89569e1ae7b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:16.761761 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 183/364] 10.222.0.73 () {56 vars in 1177 bytes} [Wed Jul 27 17:52:16 2022] GET /identity/v3/users/37aecc8547b44c54bab89e48cbefe4f1 => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:16.762355 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392226-3997-454b-9c95-c500e598e1b6 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:16.762679 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392226-3997-454b-9c95-c500e598e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:16.763189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392226-3997-454b-9c95-c500e598e1b6 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:16.765974 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 184/365] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:16.768841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392226-3997-454b-9c95-c500e598e1b6 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:16.853030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343f876-997d-4bae-bcde-7c4f6997d3f6 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:16.896421 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab351e-f5bf-42ce-8f36-8fd3d53726b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:16.897345 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab351e-f5bf-42ce-8f36-8fd3d53726b8 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:16.897633 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab351e-f5bf-42ce-8f36-8fd3d53726b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:16.897912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab351e-f5bf-42ce-8f36-8fd3d53726b8 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:16.898784 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab351e-f5bf-42ce-8f36-8fd3d53726b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:16.898996 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab351e-f5bf-42ce-8f36-8fd3d53726b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:16.900806 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab351e-f5bf-42ce-8f36-8fd3d53726b8 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:16.908598 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392226-3997-454b-9c95-c500e598e1b6 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:16.912973 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 182/366] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:16.913340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab351e-f5bf-42ce-8f36-8fd3d53726b8 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:16.959927 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:16.965835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:16.967380 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b398cb-7a70-4740-8ade-6caae5fbf6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:16.968333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b398cb-7a70-4740-8ade-6caae5fbf6df None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:16.968776 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b398cb-7a70-4740-8ade-6caae5fbf6df None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:16.969374 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b398cb-7a70-4740-8ade-6caae5fbf6df None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:16.971582 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b398cb-7a70-4740-8ade-6caae5fbf6df None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:16.973922 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b398cb-7a70-4740-8ade-6caae5fbf6df None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:16.977198 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 185/367] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:16 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:16.978490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62896d-8244-4cc2-a9d5-57b81e746d31 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:16.978858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62896d-8244-4cc2-a9d5-57b81e746d31 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:16.979138 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62896d-8244-4cc2-a9d5-57b81e746d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:17.009158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-da62896d-8244-4cc2-a9d5-57b81e746d31 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:17.010403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-da62896d-8244-4cc2-a9d5-57b81e746d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:17.065376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab351e-f5bf-42ce-8f36-8fd3d53726b8 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:17.115436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921df49-ca23-4aca-a83a-f254e9fd7593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:17.116389 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921df49-ca23-4aca-a83a-f254e9fd7593 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:17.116844 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921df49-ca23-4aca-a83a-f254e9fd7593 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:17.117315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921df49-ca23-4aca-a83a-f254e9fd7593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:17.117658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 186/368] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:17.118544 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62896d-8244-4cc2-a9d5-57b81e746d31 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:17.118896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921df49-ca23-4aca-a83a-f254e9fd7593 None admin] RBAC: Adding query filter params (role.id=1b3ca57e3e474fc79fac8dc29aedc036, user.id=37aecc8547b44c54bab89e48cbefe4f1, scope.system=all) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:17.119380 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921df49-ca23-4aca-a83a-f254e9fd7593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:17.121187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921df49-ca23-4aca-a83a-f254e9fd7593 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:17.140127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 183/369] 10.222.0.73 () {56 vars in 1308 bytes} [Wed Jul 27 17:52:16 2022] GET /identity/v3/role_assignments?user.id=37aecc8547b44c54bab89e48cbefe4f1&scope.system=all&role.id=1b3ca57e3e474fc79fac8dc29aedc036 => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:17.140806 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921df49-ca23-4aca-a83a-f254e9fd7593 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:17.253840 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62896d-8244-4cc2-a9d5-57b81e746d31 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:17.264948 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:17.269280 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921df49-ca23-4aca-a83a-f254e9fd7593 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:17.287450 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:17.296384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469e80f-4931-438e-938a-d53f99f49fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:17.297030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469e80f-4931-438e-938a-d53f99f49fe3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:17.297308 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469e80f-4931-438e-938a-d53f99f49fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:17.297818 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469e80f-4931-438e-938a-d53f99f49fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:17.308432 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011df7a-a4b6-4b16-9f65-1730fe09ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:17.309407 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011df7a-a4b6-4b16-9f65-1730fe09ba51 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:17.309868 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011df7a-a4b6-4b16-9f65-1730fe09ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:17.310316 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011df7a-a4b6-4b16-9f65-1730fe09ba51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:17.311416 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011df7a-a4b6-4b16-9f65-1730fe09ba51 None admin] RBAC: Adding query filter params (group.id=ee750fd64f0f4b8ca42e4dfc857f7f00, role.id=a2eb0e476c1f497888d73bb1d1771d16, scope.project.id=2a06dab7f53d450b855338d052303970) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:17.311908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011df7a-a4b6-4b16-9f65-1730fe09ba51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:17.314109 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011df7a-a4b6-4b16-9f65-1730fe09ba51 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:17.321097 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 184/370] 10.222.0.73 () {56 vars in 1376 bytes} [Wed Jul 27 17:52:17 2022] GET /identity/v3/role_assignments?group.id=ee750fd64f0f4b8ca42e4dfc857f7f00&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:17.322298 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011df7a-a4b6-4b16-9f65-1730fe09ba51 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:17.415311 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469e80f-4931-438e-938a-d53f99f49fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:17.416873 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469e80f-4931-438e-938a-d53f99f49fe3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:17.440862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011df7a-a4b6-4b16-9f65-1730fe09ba51 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:17.480322 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87ef40-209e-4b12-8795-94477a125aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:17.481388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ef40-209e-4b12-8795-94477a125aa0 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:17.481862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ef40-209e-4b12-8795-94477a125aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:17.482311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ef40-209e-4b12-8795-94477a125aa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:17.494783 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87ef40-209e-4b12-8795-94477a125aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-7a87ef40-209e-4b12-8795-94477a125aa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:17.501464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:17.502436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:17.503554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:17.506320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 185/371] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:52:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:17.513233 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87ef40-209e-4b12-8795-94477a125aa0 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:17.559461 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 187/372] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:17.562909 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:17.563096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469e80f-4931-438e-938a-d53f99f49fe3 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:17.602877 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:17.682536 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87ef40-209e-4b12-8795-94477a125aa0 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:17.686912 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469e80f-4931-438e-938a-d53f99f49fe3 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:17.743663 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d65be1-365f-45e7-9f40-a0458711601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:17.744572 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65be1-365f-45e7-9f40-a0458711601d None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:17.745014 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65be1-365f-45e7-9f40-a0458711601d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:17.745172 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80819c-ede8-4d5e-9cec-191b01348d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:17.745609 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65be1-365f-45e7-9f40-a0458711601d None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:17.745896 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80819c-ede8-4d5e-9cec-191b01348d6d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:17.746179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80819c-ede8-4d5e-9cec-191b01348d6d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:17.746488 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80819c-ede8-4d5e-9cec-191b01348d6d None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:17.747094 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d65be1-365f-45e7-9f40-a0458711601d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:17.747590 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d65be1-365f-45e7-9f40-a0458711601d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:17.750240 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d65be1-365f-45e7-9f40-a0458711601d None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:17.752027 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80819c-ede8-4d5e-9cec-191b01348d6d None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:17.753559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80819c-ede8-4d5e-9cec-191b01348d6d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:17.758385 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 188/373] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:17 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:17.765734 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 186/374] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:17.768107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80819c-ede8-4d5e-9cec-191b01348d6d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:17.772710 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d65be1-365f-45e7-9f40-a0458711601d None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:17.894969 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:17.923961 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d65be1-365f-45e7-9f40-a0458711601d None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:17.987047 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80819c-ede8-4d5e-9cec-191b01348d6d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:18.011350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403f2c2-5c35-406a-8a47-359ce532f5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:18.011916 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f2c2-5c35-406a-8a47-359ce532f5c1 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:18.012203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f2c2-5c35-406a-8a47-359ce532f5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:18.012483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f2c2-5c35-406a-8a47-359ce532f5c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:18.013290 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:18.029657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0736f0-4aaf-4c5f-a107-9173faac1ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:18.030325 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0736f0-4aaf-4c5f-a107-9173faac1ed9 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:18.030641 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0736f0-4aaf-4c5f-a107-9173faac1ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:18.031375 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0736f0-4aaf-4c5f-a107-9173faac1ed9 None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:18.033474 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0736f0-4aaf-4c5f-a107-9173faac1ed9 None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:18.036691 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0736f0-4aaf-4c5f-a107-9173faac1ed9 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:18.039034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 189/375] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:17 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:18.045708 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0736f0-4aaf-4c5f-a107-9173faac1ed9 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:18.168203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0736f0-4aaf-4c5f-a107-9173faac1ed9 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:18.208060 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a91ec-e58e-4d49-833c-f0833237837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:18.208706 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a91ec-e58e-4d49-833c-f0833237837e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:18.208990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a91ec-e58e-4d49-833c-f0833237837e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:18.209268 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a91ec-e58e-4d49-833c-f0833237837e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:18.210072 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a91ec-e58e-4d49-833c-f0833237837e None admin] RBAC: Adding query filter params (group.id=ee750fd64f0f4b8ca42e4dfc857f7f00, role.id=4ff7ba49d92f490cba2d9ef2f9a36e79, scope.project.id=2a06dab7f53d450b855338d052303970) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:18.210385 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a91ec-e58e-4d49-833c-f0833237837e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:18.212048 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a91ec-e58e-4d49-833c-f0833237837e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:18.218949 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 190/376] 10.222.0.73 () {56 vars in 1376 bytes} [Wed Jul 27 17:52:18 2022] GET /identity/v3/role_assignments?group.id=ee750fd64f0f4b8ca42e4dfc857f7f00&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:18.230753 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403f2c2-5c35-406a-8a47-359ce532f5c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:18.232359 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403f2c2-5c35-406a-8a47-359ce532f5c1 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:18.351013 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:18.370861 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 187/377] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:18.376875 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a91ec-e58e-4d49-833c-f0833237837e None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:18.431665 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:18.469602 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c438a-19dc-4367-8ce9-0d8376bf2585 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:18.470437 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c438a-19dc-4367-8ce9-0d8376bf2585 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:18.470437 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c438a-19dc-4367-8ce9-0d8376bf2585 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:18.472029 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 188/378] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:18.477944 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66fafb-7f50-4306-b423-71237b658e5e None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:18.478248 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66fafb-7f50-4306-b423-71237b658e5e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:18.478487 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66fafb-7f50-4306-b423-71237b658e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:18.519648 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-4a66fafb-7f50-4306-b423-71237b658e5e None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:18.520873 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-4a66fafb-7f50-4306-b423-71237b658e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:18.547095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a91ec-e58e-4d49-833c-f0833237837e None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:18.588161 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bece8-bea8-4f89-a7f5-babdf13ed3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:18.588948 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bece8-bea8-4f89-a7f5-babdf13ed3fb None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:18.589137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bece8-bea8-4f89-a7f5-babdf13ed3fb None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:18.589412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bece8-bea8-4f89-a7f5-babdf13ed3fb None admin] PATH_INFO: `/v3/projects/62c6a98aca8a4b2da0a78051d92a86b2` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:18.594020 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bece8-bea8-4f89-a7f5-babdf13ed3fb None admin] RBAC: Authorizing `identity:get_project(project_id=62c6a98aca8a4b2da0a78051d92a86b2)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:18.594020 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bece8-bea8-4f89-a7f5-babdf13ed3fb None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:18.594480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 191/379] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:18 2022] GET /identity/v3/projects/62c6a98aca8a4b2da0a78051d92a86b2 => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:18.599734 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bece8-bea8-4f89-a7f5-babdf13ed3fb None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:18.682821 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 189/380] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:18.710936 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:18.716051 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bece8-bea8-4f89-a7f5-babdf13ed3fb None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:18.730385 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66fafb-7f50-4306-b423-71237b658e5e None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:18.772812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f60a2f-41bb-42a5-80b6-6edd1a971a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:18.773483 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f60a2f-41bb-42a5-80b6-6edd1a971a33 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:18.773768 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f60a2f-41bb-42a5-80b6-6edd1a971a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:18.774050 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f60a2f-41bb-42a5-80b6-6edd1a971a33 None admin] PATH_INFO: `/v3/groups/4293dc40edac47f2b88092924f832d0c` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:18.781254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f60a2f-41bb-42a5-80b6-6edd1a971a33 None admin] RBAC: Authorizing `identity:get_group(group_id=4293dc40edac47f2b88092924f832d0c)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:18.783319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f60a2f-41bb-42a5-80b6-6edd1a971a33 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:18.785411 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 192/381] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:18 2022] GET /identity/v3/groups/4293dc40edac47f2b88092924f832d0c => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:18.797892 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f60a2f-41bb-42a5-80b6-6edd1a971a33 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:18.908285 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f60a2f-41bb-42a5-80b6-6edd1a971a33 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:18.948107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9239221-d162-4722-abaa-d93964a2ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:18.948810 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239221-d162-4722-abaa-d93964a2ec64 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:18.949164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239221-d162-4722-abaa-d93964a2ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:18.949519 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239221-d162-4722-abaa-d93964a2ec64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:18.950397 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9239221-d162-4722-abaa-d93964a2ec64 None admin] RBAC: Adding query filter params (group.id=4293dc40edac47f2b88092924f832d0c, role.id=d6d0c56d1054455c813546a2c761a7d0, scope.project.id=62c6a98aca8a4b2da0a78051d92a86b2) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:18.950907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9239221-d162-4722-abaa-d93964a2ec64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:18.952732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9239221-d162-4722-abaa-d93964a2ec64 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:18.964793 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 193/382] 10.222.0.73 () {56 vars in 1376 bytes} [Wed Jul 27 17:52:18 2022] GET /identity/v3/role_assignments?group.id=4293dc40edac47f2b88092924f832d0c&scope.project.id=62c6a98aca8a4b2da0a78051d92a86b2&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:18.967558 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66fafb-7f50-4306-b423-71237b658e5e None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:18.995255 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:19.027409 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dc344-b257-4040-bb22-9dfe4b378d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:19.028086 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc344-b257-4040-bb22-9dfe4b378d34 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:19.028366 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc344-b257-4040-bb22-9dfe4b378d34 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:19.028635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc344-b257-4040-bb22-9dfe4b378d34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:19.053218 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dc344-b257-4040-bb22-9dfe4b378d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-698dc344-b257-4040-bb22-9dfe4b378d34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:19.058341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:19.059311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:19.060564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 190/383] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:19.071676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9239221-d162-4722-abaa-d93964a2ec64 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:19.120676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:19.215973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9239221-d162-4722-abaa-d93964a2ec64 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:19.255368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d4516-c2d9-4d3d-a628-23a57f1f225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:19.256015 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d4516-c2d9-4d3d-a628-23a57f1f225e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:19.256359 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d4516-c2d9-4d3d-a628-23a57f1f225e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:19.256642 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d4516-c2d9-4d3d-a628-23a57f1f225e None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:19.257381 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d4516-c2d9-4d3d-a628-23a57f1f225e None admin] RBAC: Adding query filter params (name=member) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:19.257694 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d4516-c2d9-4d3d-a628-23a57f1f225e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:19.259222 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d4516-c2d9-4d3d-a628-23a57f1f225e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:19.269577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 194/384] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:19.275256 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dc344-b257-4040-bb22-9dfe4b378d34 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:19.314364 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98398-7417-4725-a2e9-749cd203f6a5 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:19.315124 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98398-7417-4725-a2e9-749cd203f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:19.315609 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98398-7417-4725-a2e9-749cd203f6a5 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:19.317529 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 195/385] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:19.324050 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24ed7-4738-4845-8284-76817bc45906 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:19.324604 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24ed7-4738-4845-8284-76817bc45906 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:19.325066 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24ed7-4738-4845-8284-76817bc45906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:19.347315 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-25d24ed7-4738-4845-8284-76817bc45906 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:19.348841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-25d24ed7-4738-4845-8284-76817bc45906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:19.398564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dc344-b257-4040-bb22-9dfe4b378d34 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:19.435421 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0fdcb-08c7-4eef-b664-3a22ff32a21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:19.436305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0fdcb-08c7-4eef-b664-3a22ff32a21e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:19.436755 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0fdcb-08c7-4eef-b664-3a22ff32a21e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:19.437170 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0fdcb-08c7-4eef-b664-3a22ff32a21e None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:19.437899 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 196/386] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:19.438728 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0fdcb-08c7-4eef-b664-3a22ff32a21e None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:19.440439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0fdcb-08c7-4eef-b664-3a22ff32a21e None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:19.447653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 191/387] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:19 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:19.447876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d24ed7-4738-4845-8284-76817bc45906 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:19.467649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:19.471631 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0fdcb-08c7-4eef-b664-3a22ff32a21e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:19.543079 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:19.589198 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d24ed7-4738-4845-8284-76817bc45906 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:19.633432 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0fdcb-08c7-4eef-b664-3a22ff32a21e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:19.634889 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecae4a-f911-4cca-9f89-da62477ca2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:19.635795 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecae4a-f911-4cca-9f89-da62477ca2d0 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:19.636274 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecae4a-f911-4cca-9f89-da62477ca2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:19.636721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecae4a-f911-4cca-9f89-da62477ca2d0 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:19.638087 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecae4a-f911-4cca-9f89-da62477ca2d0 None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:19.639755 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecae4a-f911-4cca-9f89-da62477ca2d0 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:19.642165 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 197/388] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:19 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:19.648101 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecae4a-f911-4cca-9f89-da62477ca2d0 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:19.673474 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4554d-aa34-44d3-b7f0-4167a7d7905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:19.674155 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4554d-aa34-44d3-b7f0-4167a7d7905e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:19.674408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4554d-aa34-44d3-b7f0-4167a7d7905e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:19.674739 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4554d-aa34-44d3-b7f0-4167a7d7905e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:19.686063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4554d-aa34-44d3-b7f0-4167a7d7905e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-ada4554d-aa34-44d3-b7f0-4167a7d7905e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:19.693685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:19.694686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:19.695520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 192/389] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:52:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:19.701170 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4554d-aa34-44d3-b7f0-4167a7d7905e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:19.745388 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:19.764647 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecae4a-f911-4cca-9f89-da62477ca2d0 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:19.802900 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e59d4-f1c9-442a-b255-c2573e10dc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:19.803802 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e59d4-f1c9-442a-b255-c2573e10dc59 None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:19.804228 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e59d4-f1c9-442a-b255-c2573e10dc59 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:19.804645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e59d4-f1c9-442a-b255-c2573e10dc59 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592/groups/ee750fd64f0f4b8ca42e4dfc857f7f00/roles/a2eb0e476c1f497888d73bb1d1771d16` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:19.808547 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e59d4-f1c9-442a-b255-c2573e10dc59 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a43597721514990bc6b893382806592, group_id=ee750fd64f0f4b8ca42e4dfc857f7f00, role_id=a2eb0e476c1f497888d73bb1d1771d16)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:19.810153 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e59d4-f1c9-442a-b255-c2573e10dc59 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:19.830209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 198/390] 10.222.0.73 () {58 vars in 1442 bytes} [Wed Jul 27 17:52:19 2022] PUT /identity/v3/projects/4a43597721514990bc6b893382806592/groups/ee750fd64f0f4b8ca42e4dfc857f7f00/roles/a2eb0e476c1f497888d73bb1d1771d16 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:19.833681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4554d-aa34-44d3-b7f0-4167a7d7905e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:19.836465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:19.877537 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f072881-663f-4b70-b968-a365bdf68ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:19.878179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f072881-663f-4b70-b968-a365bdf68ea2 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:19.878462 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f072881-663f-4b70-b968-a365bdf68ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:19.878776 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f072881-663f-4b70-b968-a365bdf68ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:19.879610 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f072881-663f-4b70-b968-a365bdf68ea2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:19.879919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f072881-663f-4b70-b968-a365bdf68ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:19.881404 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f072881-663f-4b70-b968-a365bdf68ea2 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:19.891476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 193/391] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:19.898370 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e59d4-f1c9-442a-b255-c2573e10dc59 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:20.032756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e59d4-f1c9-442a-b255-c2573e10dc59 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:20.072026 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ebaca-e4f0-409d-9e4e-627840f1d351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:20.073103 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ebaca-e4f0-409d-9e4e-627840f1d351 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:20.073589 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ebaca-e4f0-409d-9e4e-627840f1d351 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:20.074066 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ebaca-e4f0-409d-9e4e-627840f1d351 None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:20.075467 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ebaca-e4f0-409d-9e4e-627840f1d351 None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:20.077143 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ebaca-e4f0-409d-9e4e-627840f1d351 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:20.079366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 199/392] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:19 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:20.085311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f072881-663f-4b70-b968-a365bdf68ea2 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:20.209439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f072881-663f-4b70-b968-a365bdf68ea2 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:20.253892 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd84b21-975b-4aba-9153-86520dc78473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:20.255029 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84b21-975b-4aba-9153-86520dc78473 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:20.255557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84b21-975b-4aba-9153-86520dc78473 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:20.256028 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84b21-975b-4aba-9153-86520dc78473 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:20.258950 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd84b21-975b-4aba-9153-86520dc78473 None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:20.260608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd84b21-975b-4aba-9153-86520dc78473 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:20.262618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 194/393] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:20 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:20.269078 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ebaca-e4f0-409d-9e4e-627840f1d351 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:20.285804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:20.385769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ebaca-e4f0-409d-9e4e-627840f1d351 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:20.423905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf2132-a745-4b16-81e8-b8d5dfdfdfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:20.424628 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2132-a745-4b16-81e8-b8d5dfdfdfa1 None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:20.424947 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2132-a745-4b16-81e8-b8d5dfdfdfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:20.425224 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2132-a745-4b16-81e8-b8d5dfdfdfa1 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592/groups/ee750fd64f0f4b8ca42e4dfc857f7f00/roles/4ff7ba49d92f490cba2d9ef2f9a36e79` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:20.427491 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf2132-a745-4b16-81e8-b8d5dfdfdfa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a43597721514990bc6b893382806592, group_id=ee750fd64f0f4b8ca42e4dfc857f7f00, role_id=4ff7ba49d92f490cba2d9ef2f9a36e79)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:20.428918 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf2132-a745-4b16-81e8-b8d5dfdfdfa1 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:20.445912 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 200/394] 10.222.0.73 () {58 vars in 1442 bytes} [Wed Jul 27 17:52:20 2022] PUT /identity/v3/projects/4a43597721514990bc6b893382806592/groups/ee750fd64f0f4b8ca42e4dfc857f7f00/roles/4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 17:52:21.016223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f6107-ca6d-45d0-98a1-1fac4fad5562 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:21.016784 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f6107-ca6d-45d0-98a1-1fac4fad5562 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:21.016933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f6107-ca6d-45d0-98a1-1fac4fad5562 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:21.018530 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 195/395] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:21.032288 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5010392-27de-4a97-a77a-93548e7ea975 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:21.033444 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5010392-27de-4a97-a77a-93548e7ea975 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:21.033444 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5010392-27de-4a97-a77a-93548e7ea975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:21.060302 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-c5010392-27de-4a97-a77a-93548e7ea975 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:21.061422 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-c5010392-27de-4a97-a77a-93548e7ea975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:21.107644 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42492d-aba2-4138-8ddd-c8cd8f6f1fc8 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:21.107971 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42492d-aba2-4138-8ddd-c8cd8f6f1fc8 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:21.108203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42492d-aba2-4138-8ddd-c8cd8f6f1fc8 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:21.109669 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 196/396] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:21.115202 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c590a-6bcd-4f94-8282-0fac92e73cdb None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:21.115784 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c590a-6bcd-4f94-8282-0fac92e73cdb None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:21.116257 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c590a-6bcd-4f94-8282-0fac92e73cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:21.136626 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-f26c590a-6bcd-4f94-8282-0fac92e73cdb None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:21.138492 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-f26c590a-6bcd-4f94-8282-0fac92e73cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:21.170936 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:21.172637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 201/397] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:21.210740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5010392-27de-4a97-a77a-93548e7ea975 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:21.212943 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:21.223447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 197/398] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:21.245949 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c590a-6bcd-4f94-8282-0fac92e73cdb None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:21.437636 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c590a-6bcd-4f94-8282-0fac92e73cdb None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:21.451581 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5010392-27de-4a97-a77a-93548e7ea975 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:21.506141 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6992587-5df3-4cfc-8f08-45d5104db569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:21.507115 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6992587-5df3-4cfc-8f08-45d5104db569 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:21.507735 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6992587-5df3-4cfc-8f08-45d5104db569 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:21.509336 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6992587-5df3-4cfc-8f08-45d5104db569 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:21.517728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9efce-9f4f-4942-9451-a3a2f8760722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:21.518697 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9efce-9f4f-4942-9451-a3a2f8760722 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:21.519153 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9efce-9f4f-4942-9451-a3a2f8760722 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:21.519615 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9efce-9f4f-4942-9451-a3a2f8760722 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:21.531877 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6992587-5df3-4cfc-8f08-45d5104db569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-f6992587-5df3-4cfc-8f08-45d5104db569 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:21.537458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:21.538320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:21.539203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:21.544413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9efce-9f4f-4942-9451-a3a2f8760722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-2db9efce-9f4f-4942-9451-a3a2f8760722 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:21.550549 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:21.551618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:21.552758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 202/399] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:21.553643 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 198/400] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:52:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:21.557786 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9efce-9f4f-4942-9451-a3a2f8760722 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:21.559785 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6992587-5df3-4cfc-8f08-45d5104db569 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:21.612490 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:21.638914 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:21.673884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9efce-9f4f-4942-9451-a3a2f8760722 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:21.711189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40232bc-d429-4a7f-9b9d-73b9242e460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:21.712102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40232bc-d429-4a7f-9b9d-73b9242e460d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:21.712565 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40232bc-d429-4a7f-9b9d-73b9242e460d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:21.713011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40232bc-d429-4a7f-9b9d-73b9242e460d None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:21.713966 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40232bc-d429-4a7f-9b9d-73b9242e460d None admin] RBAC: Adding query filter params (name=member) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:21.714453 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40232bc-d429-4a7f-9b9d-73b9242e460d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:21.716057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40232bc-d429-4a7f-9b9d-73b9242e460d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:21.725477 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 203/401] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:21.740882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40232bc-d429-4a7f-9b9d-73b9242e460d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:21.762588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6992587-5df3-4cfc-8f08-45d5104db569 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:21.811253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b07d8-3384-413a-8b11-1e9ef3d6f6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:21.811899 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b07d8-3384-413a-8b11-1e9ef3d6f6ef None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:21.812186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b07d8-3384-413a-8b11-1e9ef3d6f6ef None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:21.812467 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b07d8-3384-413a-8b11-1e9ef3d6f6ef None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:21.813205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b07d8-3384-413a-8b11-1e9ef3d6f6ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:21.813515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b07d8-3384-413a-8b11-1e9ef3d6f6ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:21.815990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b07d8-3384-413a-8b11-1e9ef3d6f6ef None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:21.831644 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 199/402] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:21.845691 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b07d8-3384-413a-8b11-1e9ef3d6f6ef None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:21.874018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40232bc-d429-4a7f-9b9d-73b9242e460d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:21.900251 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:21.912003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be24b51-3c78-435f-bf96-3e3890895f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:21.913960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be24b51-3c78-435f-bf96-3e3890895f5d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:21.914242 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be24b51-3c78-435f-bf96-3e3890895f5d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:21.914534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be24b51-3c78-435f-bf96-3e3890895f5d None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:21.915883 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be24b51-3c78-435f-bf96-3e3890895f5d None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:21.917389 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be24b51-3c78-435f-bf96-3e3890895f5d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:21.920515 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 204/403] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:21 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:21.928093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be24b51-3c78-435f-bf96-3e3890895f5d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:22.041248 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be24b51-3c78-435f-bf96-3e3890895f5d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:22.075648 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:22.080349 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb2848-37b2-49d7-abe8-181913083bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:22.081040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2848-37b2-49d7-abe8-181913083bd3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:22.081338 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2848-37b2-49d7-abe8-181913083bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:22.081616 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2848-37b2-49d7-abe8-181913083bd3 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:22.083474 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb2848-37b2-49d7-abe8-181913083bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:22.084938 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb2848-37b2-49d7-abe8-181913083bd3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:22.088049 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 205/404] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:21 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:22.095651 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb2848-37b2-49d7-abe8-181913083bd3 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:22.104098 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b07d8-3384-413a-8b11-1e9ef3d6f6ef None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:22.170301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d77d43-d6c5-417e-9407-380f1f70f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:22.170989 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d77d43-d6c5-417e-9407-380f1f70f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:22.171278 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d77d43-d6c5-417e-9407-380f1f70f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:22.171556 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d77d43-d6c5-417e-9407-380f1f70f3e4 None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:22.174414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d77d43-d6c5-417e-9407-380f1f70f3e4 None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:22.175914 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d77d43-d6c5-417e-9407-380f1f70f3e4 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:22.177848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 200/405] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:21 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:22.191566 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d77d43-d6c5-417e-9407-380f1f70f3e4 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:22.201754 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:22.248435 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb2848-37b2-49d7-abe8-181913083bd3 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:22.288350 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc07866-f746-4486-a71b-f4090113edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:22.289295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc07866-f746-4486-a71b-f4090113edc5 None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:22.289724 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc07866-f746-4486-a71b-f4090113edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:22.290144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc07866-f746-4486-a71b-f4090113edc5 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970/groups/ee750fd64f0f4b8ca42e4dfc857f7f00/roles/a2eb0e476c1f497888d73bb1d1771d16` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:22.292432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc07866-f746-4486-a71b-f4090113edc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a06dab7f53d450b855338d052303970, group_id=ee750fd64f0f4b8ca42e4dfc857f7f00, role_id=a2eb0e476c1f497888d73bb1d1771d16)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:22.294847 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc07866-f746-4486-a71b-f4090113edc5 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:22.314254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 206/406] 10.222.0.73 () {58 vars in 1442 bytes} [Wed Jul 27 17:52:22 2022] PUT /identity/v3/projects/2a06dab7f53d450b855338d052303970/groups/ee750fd64f0f4b8ca42e4dfc857f7f00/roles/a2eb0e476c1f497888d73bb1d1771d16 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:22.409202 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d77d43-d6c5-417e-9407-380f1f70f3e4 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:22.462281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c7b6-40a0-4adf-817f-0fd05b19c829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:22.462987 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c7b6-40a0-4adf-817f-0fd05b19c829 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:22.463275 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c7b6-40a0-4adf-817f-0fd05b19c829 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:22.463557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c7b6-40a0-4adf-817f-0fd05b19c829 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:22.464765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060c7b6-40a0-4adf-817f-0fd05b19c829 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:22.466240 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060c7b6-40a0-4adf-817f-0fd05b19c829 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:22.468249 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 201/407] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:22 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:22.475139 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc07866-f746-4486-a71b-f4090113edc5 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:22.654923 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc07866-f746-4486-a71b-f4090113edc5 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:22.677512 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:22.695160 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75dbba-dc7f-484b-adc7-904476e6c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:22.695839 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75dbba-dc7f-484b-adc7-904476e6c02e None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:22.696120 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75dbba-dc7f-484b-adc7-904476e6c02e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:22.696396 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75dbba-dc7f-484b-adc7-904476e6c02e None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970/groups/ee750fd64f0f4b8ca42e4dfc857f7f00/roles/4ff7ba49d92f490cba2d9ef2f9a36e79` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:22.698589 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75dbba-dc7f-484b-adc7-904476e6c02e None admin] RBAC: Authorizing `identity:create_grant(project_id=2a06dab7f53d450b855338d052303970, group_id=ee750fd64f0f4b8ca42e4dfc857f7f00, role_id=4ff7ba49d92f490cba2d9ef2f9a36e79)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:22.700035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75dbba-dc7f-484b-adc7-904476e6c02e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:22.709018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e3e8-fd99-4d8a-8e07-550f519c18ef None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:22.709645 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e3e8-fd99-4d8a-8e07-550f519c18ef None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:22.710121 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e3e8-fd99-4d8a-8e07-550f519c18ef None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:22.711829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 202/408] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:22.717341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ae23-d0b3-4407-80fa-b3100a3bb8b7 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:22.717855 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ae23-d0b3-4407-80fa-b3100a3bb8b7 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:22.718351 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ae23-d0b3-4407-80fa-b3100a3bb8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:22.722615 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 207/409] 10.222.0.73 () {58 vars in 1442 bytes} [Wed Jul 27 17:52:22 2022] PUT /identity/v3/projects/2a06dab7f53d450b855338d052303970/groups/ee750fd64f0f4b8ca42e4dfc857f7f00/roles/4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:22.739027 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9806a-6497-4cd9-8098-6394d9bbb6e6 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:22.739876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9806a-6497-4cd9-8098-6394d9bbb6e6 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:22.740374 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9806a-6497-4cd9-8098-6394d9bbb6e6 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:22.741989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 208/410] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:22.746682 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-d9f1ae23-d0b3-4407-80fa-b3100a3bb8b7 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:22.746682 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-d9f1ae23-d0b3-4407-80fa-b3100a3bb8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:22.748660 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6dee1-bc79-471b-a053-bec3dfc53b61 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:22.749203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6dee1-bc79-471b-a053-bec3dfc53b61 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:22.749800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6dee1-bc79-471b-a053-bec3dfc53b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:22.771021 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-a3c6dee1-bc79-471b-a053-bec3dfc53b61 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:22.772580 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-a3c6dee1-bc79-471b-a053-bec3dfc53b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:22.777413 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:22.852950 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 203/411] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:22.869652 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 209/412] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:22.884706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ae23-d0b3-4407-80fa-b3100a3bb8b7 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:22.908456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6dee1-bc79-471b-a053-bec3dfc53b61 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:23.004426 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ae23-d0b3-4407-80fa-b3100a3bb8b7 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:23.042619 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91508468-c907-4292-8613-41e67b48f383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:23.043452 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91508468-c907-4292-8613-41e67b48f383 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:23.043737 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91508468-c907-4292-8613-41e67b48f383 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:23.044006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91508468-c907-4292-8613-41e67b48f383 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:23.057775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91508468-c907-4292-8613-41e67b48f383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-91508468-c907-4292-8613-41e67b48f383 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:23.063810 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:23.064830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:23.065672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 204/413] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:23.070698 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6dee1-bc79-471b-a053-bec3dfc53b61 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:23.077255 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91508468-c907-4292-8613-41e67b48f383 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:23.086919 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:23.106953 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:23.135179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4449f7d-cde9-4913-989a-d0c24689ecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:23.135840 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4449f7d-cde9-4913-989a-d0c24689ecfa None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:23.136167 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4449f7d-cde9-4913-989a-d0c24689ecfa None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:23.136450 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4449f7d-cde9-4913-989a-d0c24689ecfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:23.161358 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4449f7d-cde9-4913-989a-d0c24689ecfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-d4449f7d-cde9-4913-989a-d0c24689ecfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:23.168054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:23.169011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:23.169821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:23.170434 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 210/414] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:23.182633 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4449f7d-cde9-4913-989a-d0c24689ecfa None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:23.299138 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4449f7d-cde9-4913-989a-d0c24689ecfa None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:23.312141 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91508468-c907-4292-8613-41e67b48f383 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:23.349617 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df5af1-73b5-4f40-a1f1-709466ba7057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:23.350628 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df5af1-73b5-4f40-a1f1-709466ba7057 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:23.351060 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df5af1-73b5-4f40-a1f1-709466ba7057 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:23.351475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df5af1-73b5-4f40-a1f1-709466ba7057 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:23.352371 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df5af1-73b5-4f40-a1f1-709466ba7057 None admin] RBAC: Adding query filter params (name=member) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:23.352876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df5af1-73b5-4f40-a1f1-709466ba7057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:23.354503 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df5af1-73b5-4f40-a1f1-709466ba7057 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:23.365811 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 205/415] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:23.374848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df5af1-73b5-4f40-a1f1-709466ba7057 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:23.389250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939a73-1ec8-412c-aa44-e2c985286065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:23.389889 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939a73-1ec8-412c-aa44-e2c985286065 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:23.390171 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939a73-1ec8-412c-aa44-e2c985286065 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:23.390446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939a73-1ec8-412c-aa44-e2c985286065 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:23.391200 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90939a73-1ec8-412c-aa44-e2c985286065 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:23.391509 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90939a73-1ec8-412c-aa44-e2c985286065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:23.392947 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90939a73-1ec8-412c-aa44-e2c985286065 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:23.408498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 211/416] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:23.416117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939a73-1ec8-412c-aa44-e2c985286065 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:23.492058 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:23.492441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:23.517392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df5af1-73b5-4f40-a1f1-709466ba7057 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:23.559675 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904116f8-efc0-46c3-aa19-97f23c79a843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:23.560809 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904116f8-efc0-46c3-aa19-97f23c79a843 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:23.561232 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904116f8-efc0-46c3-aa19-97f23c79a843 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:23.561648 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904116f8-efc0-46c3-aa19-97f23c79a843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:23.602207 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939a73-1ec8-412c-aa44-e2c985286065 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:23.644895 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a0f82-02c5-41c4-b25d-c764fa617c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:23.646554 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0f82-02c5-41c4-b25d-c764fa617c94 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:23.646554 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0f82-02c5-41c4-b25d-c764fa617c94 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:23.646554 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0f82-02c5-41c4-b25d-c764fa617c94 None admin] PATH_INFO: `/v3/groups/4293dc40edac47f2b88092924f832d0c` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:23.649996 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a0f82-02c5-41c4-b25d-c764fa617c94 None admin] RBAC: Authorizing `identity:get_group(group_id=4293dc40edac47f2b88092924f832d0c)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:23.649996 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a0f82-02c5-41c4-b25d-c764fa617c94 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:23.653974 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 212/417] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:23 2022] GET /identity/v3/groups/4293dc40edac47f2b88092924f832d0c => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:23.656237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112822b-94cf-4640-85ec-083b90511d16 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:23.656347 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112822b-94cf-4640-85ec-083b90511d16 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:23.656557 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112822b-94cf-4640-85ec-083b90511d16 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:23.659478 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 213/418] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:23.660079 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112822b-94cf-4640-85ec-083b90511d16 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:23.665070 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904116f8-efc0-46c3-aa19-97f23c79a843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:23.666630 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904116f8-efc0-46c3-aa19-97f23c79a843 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:23.761616 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:23.801085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 206/419] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 17:52:23.802638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739eb7-8d29-4a17-a948-0eabd64426de None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:23.803053 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739eb7-8d29-4a17-a948-0eabd64426de None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:23.803452 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739eb7-8d29-4a17-a948-0eabd64426de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:23.807960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:23.812670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112822b-94cf-4640-85ec-083b90511d16 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:23.828960 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-55739eb7-8d29-4a17-a948-0eabd64426de None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:23.831221 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-55739eb7-8d29-4a17-a948-0eabd64426de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:23.853272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eca0b-9f56-48d2-826c-f4ed6a120db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:23.854631 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eca0b-9f56-48d2-826c-f4ed6a120db8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:23.855089 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eca0b-9f56-48d2-826c-f4ed6a120db8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:23.855520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eca0b-9f56-48d2-826c-f4ed6a120db8 None admin] PATH_INFO: `/v3/projects/62c6a98aca8a4b2da0a78051d92a86b2` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:23.856821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538eca0b-9f56-48d2-826c-f4ed6a120db8 None admin] RBAC: Authorizing `identity:get_project(project_id=62c6a98aca8a4b2da0a78051d92a86b2)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:23.859373 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538eca0b-9f56-48d2-826c-f4ed6a120db8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:23.861979 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 214/420] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:23 2022] GET /identity/v3/projects/62c6a98aca8a4b2da0a78051d92a86b2 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:23.863403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eca0b-9f56-48d2-826c-f4ed6a120db8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:23.917310 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 207/421] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:23.919201 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55739eb7-8d29-4a17-a948-0eabd64426de None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:24.010182 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eca0b-9f56-48d2-826c-f4ed6a120db8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:24.048755 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55739eb7-8d29-4a17-a948-0eabd64426de None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:24.049793 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b6dd2-1409-4bec-82f2-3300861975e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:24.050449 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b6dd2-1409-4bec-82f2-3300861975e7 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:24.050756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b6dd2-1409-4bec-82f2-3300861975e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:24.051025 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b6dd2-1409-4bec-82f2-3300861975e7 None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:24.052198 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b6dd2-1409-4bec-82f2-3300861975e7 None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:24.052660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:24.054333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b6dd2-1409-4bec-82f2-3300861975e7 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:24.055918 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 215/422] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:23 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:24.057054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b6dd2-1409-4bec-82f2-3300861975e7 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:24.098339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:24.104882 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b107a38-d926-44f0-88e5-76e4342536a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:24.106757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b107a38-d926-44f0-88e5-76e4342536a5 None admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:24.107268 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b107a38-d926-44f0-88e5-76e4342536a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:24.108150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b107a38-d926-44f0-88e5-76e4342536a5 None admin] PATH_INFO: `/v3/projects/62c6a98aca8a4b2da0a78051d92a86b2/groups/4293dc40edac47f2b88092924f832d0c/roles/d6d0c56d1054455c813546a2c761a7d0` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:24.111004 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b107a38-d926-44f0-88e5-76e4342536a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c6a98aca8a4b2da0a78051d92a86b2, group_id=4293dc40edac47f2b88092924f832d0c, role_id=d6d0c56d1054455c813546a2c761a7d0)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:24.113561 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b107a38-d926-44f0-88e5-76e4342536a5 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:24.132572 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 208/423] 10.222.0.73 () {58 vars in 1442 bytes} [Wed Jul 27 17:52:23 2022] PUT /identity/v3/projects/62c6a98aca8a4b2da0a78051d92a86b2/groups/4293dc40edac47f2b88092924f832d0c/roles/d6d0c56d1054455c813546a2c761a7d0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:24.133853 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b107a38-d926-44f0-88e5-76e4342536a5 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:24.244881 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b6dd2-1409-4bec-82f2-3300861975e7 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:24.273980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b107a38-d926-44f0-88e5-76e4342536a5 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:24.318488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51c13b-287f-4415-9e2f-172e4dc3dc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:24.319690 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c13b-287f-4415-9e2f-172e4dc3dc6c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:24.320170 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c13b-287f-4415-9e2f-172e4dc3dc6c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:24.320919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c13b-287f-4415-9e2f-172e4dc3dc6c None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:24.326868 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51c13b-287f-4415-9e2f-172e4dc3dc6c None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:24.329956 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51c13b-287f-4415-9e2f-172e4dc3dc6c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:24.332496 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 209/424] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:24 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:24.338062 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51c13b-287f-4415-9e2f-172e4dc3dc6c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:24.350967 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad614f6a-6c2e-40cd-b55c-f94589ff3077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:24.352098 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad614f6a-6c2e-40cd-b55c-f94589ff3077 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:24.352579 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad614f6a-6c2e-40cd-b55c-f94589ff3077 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:24.353209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad614f6a-6c2e-40cd-b55c-f94589ff3077 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:24.383191 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad614f6a-6c2e-40cd-b55c-f94589ff3077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-ad614f6a-6c2e-40cd-b55c-f94589ff3077 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:24.390590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:24.391534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:24.393006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 216/425] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:52:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:24.400457 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad614f6a-6c2e-40cd-b55c-f94589ff3077 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:24.419199 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:24.479114 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51c13b-287f-4415-9e2f-172e4dc3dc6c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:24.507417 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:24.513334 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad614f6a-6c2e-40cd-b55c-f94589ff3077 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:24.543257 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6745e5-98a4-4747-bc7b-0abd5471ae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:24.543893 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6745e5-98a4-4747-bc7b-0abd5471ae43 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:24.544173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6745e5-98a4-4747-bc7b-0abd5471ae43 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:24.544449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6745e5-98a4-4747-bc7b-0abd5471ae43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:24.545248 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6745e5-98a4-4747-bc7b-0abd5471ae43 None admin] RBAC: Adding query filter params (group.id=ee750fd64f0f4b8ca42e4dfc857f7f00, role.id=a2eb0e476c1f497888d73bb1d1771d16, scope.project.id=4a43597721514990bc6b893382806592) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:24.545557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6745e5-98a4-4747-bc7b-0abd5471ae43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:24.547031 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6745e5-98a4-4747-bc7b-0abd5471ae43 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:24.552869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e800a7-9b69-45da-b4e0-38c6d0ee25c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:24.553803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e800a7-9b69-45da-b4e0-38c6d0ee25c5 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:24.554189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e800a7-9b69-45da-b4e0-38c6d0ee25c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:24.554637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e800a7-9b69-45da-b4e0-38c6d0ee25c5 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:24.555482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e800a7-9b69-45da-b4e0-38c6d0ee25c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:24.555892 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e800a7-9b69-45da-b4e0-38c6d0ee25c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:24.557644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e800a7-9b69-45da-b4e0-38c6d0ee25c5 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:24.564824 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 210/426] 10.222.0.73 () {56 vars in 1376 bytes} [Wed Jul 27 17:52:24 2022] GET /identity/v3/role_assignments?group.id=ee750fd64f0f4b8ca42e4dfc857f7f00&scope.project.id=4a43597721514990bc6b893382806592&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:24.568856 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 217/427] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:24.574772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6745e5-98a4-4747-bc7b-0abd5471ae43 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:24.682691 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:24.689336 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6745e5-98a4-4747-bc7b-0abd5471ae43 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:24.727846 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd173378-a31a-48e8-a0d3-ce7d9645c60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:24.728540 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173378-a31a-48e8-a0d3-ce7d9645c60d None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:24.728817 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173378-a31a-48e8-a0d3-ce7d9645c60d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:24.729139 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173378-a31a-48e8-a0d3-ce7d9645c60d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:24.808006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd173378-a31a-48e8-a0d3-ce7d9645c60d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:24.809539 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd173378-a31a-48e8-a0d3-ce7d9645c60d None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:24.918026 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:24.929943 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 211/428] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:24.935741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e800a7-9b69-45da-b4e0-38c6d0ee25c5 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:25.046600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e800a7-9b69-45da-b4e0-38c6d0ee25c5 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:25.089798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688b390-b72d-4cc9-b58c-aaa881f4c29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:25.090443 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688b390-b72d-4cc9-b58c-aaa881f4c29e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:25.090754 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688b390-b72d-4cc9-b58c-aaa881f4c29e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:25.091033 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688b390-b72d-4cc9-b58c-aaa881f4c29e None admin] PATH_INFO: `/v3/projects/4a43597721514990bc6b893382806592` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:25.092203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688b390-b72d-4cc9-b58c-aaa881f4c29e None admin] RBAC: Authorizing `identity:get_project(project_id=4a43597721514990bc6b893382806592)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:25.093736 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688b390-b72d-4cc9-b58c-aaa881f4c29e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:25.096448 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 218/429] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:24 2022] GET /identity/v3/projects/4a43597721514990bc6b893382806592 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:25.101989 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd173378-a31a-48e8-a0d3-ce7d9645c60d None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:25.217499 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd173378-a31a-48e8-a0d3-ce7d9645c60d None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:25.254164 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f468d8-e61a-4cb6-b6ad-4340ed9aaa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:25.254884 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f468d8-e61a-4cb6-b6ad-4340ed9aaa63 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:25.255126 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f468d8-e61a-4cb6-b6ad-4340ed9aaa63 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:25.255393 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f468d8-e61a-4cb6-b6ad-4340ed9aaa63 None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:25.256597 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f468d8-e61a-4cb6-b6ad-4340ed9aaa63 None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:25.258096 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f468d8-e61a-4cb6-b6ad-4340ed9aaa63 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:25.260169 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 212/430] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:25 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:25.266402 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688b390-b72d-4cc9-b58c-aaa881f4c29e None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:25.307253 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:25.313960 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607b869-7231-418d-8c3c-fa3f19e49061 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:25.314259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607b869-7231-418d-8c3c-fa3f19e49061 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:25.314538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607b869-7231-418d-8c3c-fa3f19e49061 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:25.316789 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 213/431] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:25.327441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0aace-0a9f-4dee-a0e7-0e661f5221a9 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:25.327855 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0aace-0a9f-4dee-a0e7-0e661f5221a9 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:25.328140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0aace-0a9f-4dee-a0e7-0e661f5221a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:25.353326 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-45d0aace-0a9f-4dee-a0e7-0e661f5221a9 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:25.354876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-45d0aace-0a9f-4dee-a0e7-0e661f5221a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:25.418037 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688b390-b72d-4cc9-b58c-aaa881f4c29e None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:25.438577 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 214/432] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:25.439488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:25.453995 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7553e-5646-4650-9b86-39b7a92286d9 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:25.454819 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7553e-5646-4650-9b86-39b7a92286d9 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:25.455310 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7553e-5646-4650-9b86-39b7a92286d9 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:25.457125 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 215/433] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:25.462643 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d79fc-a41e-40fb-90e6-e23880253ea2 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:25.463464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d79fc-a41e-40fb-90e6-e23880253ea2 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:25.463966 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d79fc-a41e-40fb-90e6-e23880253ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:25.471177 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1cc8-0ff2-4c1c-a766-3620528235ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:25.471748 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1cc8-0ff2-4c1c-a766-3620528235ac None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:25.472033 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1cc8-0ff2-4c1c-a766-3620528235ac None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:25.472310 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1cc8-0ff2-4c1c-a766-3620528235ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:25.473753 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb1cc8-0ff2-4c1c-a766-3620528235ac None admin] RBAC: Adding query filter params (group.id=ee750fd64f0f4b8ca42e4dfc857f7f00, role.id=4ff7ba49d92f490cba2d9ef2f9a36e79, scope.project.id=4a43597721514990bc6b893382806592) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:25.473753 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb1cc8-0ff2-4c1c-a766-3620528235ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:25.475165 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb1cc8-0ff2-4c1c-a766-3620528235ac None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:25.481880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 219/434] 10.222.0.73 () {56 vars in 1376 bytes} [Wed Jul 27 17:52:25 2022] GET /identity/v3/role_assignments?group.id=ee750fd64f0f4b8ca42e4dfc857f7f00&scope.project.id=4a43597721514990bc6b893382806592&role.id=4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:25.482734 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1cc8-0ff2-4c1c-a766-3620528235ac None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:25.484614 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-8d6d79fc-a41e-40fb-90e6-e23880253ea2 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:25.486428 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-8d6d79fc-a41e-40fb-90e6-e23880253ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:25.577720 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 216/435] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:25.591323 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:25.604854 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d79fc-a41e-40fb-90e6-e23880253ea2 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:25.605774 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1cc8-0ff2-4c1c-a766-3620528235ac None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:25.645515 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bc299-7b98-4c18-96b1-4d39a6e11894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:25.646464 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bc299-7b98-4c18-96b1-4d39a6e11894 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:25.646938 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bc299-7b98-4c18-96b1-4d39a6e11894 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:25.647364 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bc299-7b98-4c18-96b1-4d39a6e11894 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:25.660961 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bc299-7b98-4c18-96b1-4d39a6e11894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-620bc299-7b98-4c18-96b1-4d39a6e11894 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:25.666238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:25.667425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 17:52:25.668506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:25.670462 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 220/436] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:25.679560 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bc299-7b98-4c18-96b1-4d39a6e11894 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:25.721759 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d79fc-a41e-40fb-90e6-e23880253ea2 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:25.751456 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:25.769664 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0876d-70c0-4264-8e23-cbfda61dec13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:25.770378 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0876d-70c0-4264-8e23-cbfda61dec13 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:25.770684 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0876d-70c0-4264-8e23-cbfda61dec13 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:25.770967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0876d-70c0-4264-8e23-cbfda61dec13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:25.787027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0876d-70c0-4264-8e23-cbfda61dec13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-bfd0876d-70c0-4264-8e23-cbfda61dec13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:25.793067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:25.794002 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 17:52:25.794823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:25.800160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 217/437] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:52:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:25.801471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0876d-70c0-4264-8e23-cbfda61dec13 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:25.812695 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bc299-7b98-4c18-96b1-4d39a6e11894 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:25.871469 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932f368-ec4c-4915-886e-3db694bdbf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:25.872547 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f368-ec4c-4915-886e-3db694bdbf8a None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:25.873004 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f368-ec4c-4915-886e-3db694bdbf8a None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:25.873790 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f368-ec4c-4915-886e-3db694bdbf8a None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:25.874793 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932f368-ec4c-4915-886e-3db694bdbf8a None admin] RBAC: Adding query filter params (name=member) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:25.875274 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932f368-ec4c-4915-886e-3db694bdbf8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:25.877977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932f368-ec4c-4915-886e-3db694bdbf8a None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:25.890819 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 221/438] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:52:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:25.898640 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932f368-ec4c-4915-886e-3db694bdbf8a None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:25.920283 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:25.945215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0876d-70c0-4264-8e23-cbfda61dec13 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:25.992670 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0444c00-0500-4bad-b783-de866d342f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:25.992670 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0444c00-0500-4bad-b783-de866d342f77 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:25.992670 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0444c00-0500-4bad-b783-de866d342f77 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:25.993050 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0444c00-0500-4bad-b783-de866d342f77 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:25.993642 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0444c00-0500-4bad-b783-de866d342f77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:25.993954 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0444c00-0500-4bad-b783-de866d342f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:25.995388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0444c00-0500-4bad-b783-de866d342f77 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:26.005802 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 218/439] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:26.012223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0444c00-0500-4bad-b783-de866d342f77 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:26.034839 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932f368-ec4c-4915-886e-3db694bdbf8a None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:26.065406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:26.072840 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142204a-dc5e-4723-a357-de4ba1db4c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:26.073530 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142204a-dc5e-4723-a357-de4ba1db4c0a None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:26.073832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142204a-dc5e-4723-a357-de4ba1db4c0a None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:26.074108 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142204a-dc5e-4723-a357-de4ba1db4c0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:26.121607 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0444c00-0500-4bad-b783-de866d342f77 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:26.149408 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142204a-dc5e-4723-a357-de4ba1db4c0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:26.151174 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142204a-dc5e-4723-a357-de4ba1db4c0a None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:26.159119 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d22c69-b5ee-4928-8d23-138ce61b1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:26.159748 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22c69-b5ee-4928-8d23-138ce61b1518 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:26.160035 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22c69-b5ee-4928-8d23-138ce61b1518 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:26.160323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22c69-b5ee-4928-8d23-138ce61b1518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:26.167352 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:26.234013 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d22c69-b5ee-4928-8d23-138ce61b1518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:26.236820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d22c69-b5ee-4928-8d23-138ce61b1518 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:26.261786 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 222/440] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 17:52:26.267433 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142204a-dc5e-4723-a357-de4ba1db4c0a None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:26.291812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:26.352823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 219/441] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:26.358248 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d22c69-b5ee-4928-8d23-138ce61b1518 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:26.376651 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142204a-dc5e-4723-a357-de4ba1db4c0a None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:26.391356 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:26.415503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f148de5-994d-45ad-b115-a70132c6ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:26.416156 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f148de5-994d-45ad-b115-a70132c6ad96 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:26.416919 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f148de5-994d-45ad-b115-a70132c6ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:26.417210 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f148de5-994d-45ad-b115-a70132c6ad96 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:26.418698 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f148de5-994d-45ad-b115-a70132c6ad96 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:26.420945 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f148de5-994d-45ad-b115-a70132c6ad96 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:26.427942 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 223/442] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:26 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:26.429591 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f148de5-994d-45ad-b115-a70132c6ad96 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:26.465027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d22c69-b5ee-4928-8d23-138ce61b1518 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:26.499312 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95dd3e-e496-4047-b5e7-708bb58c6375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:26.499953 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95dd3e-e496-4047-b5e7-708bb58c6375 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:26.500234 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95dd3e-e496-4047-b5e7-708bb58c6375 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:26.500515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95dd3e-e496-4047-b5e7-708bb58c6375 None admin] PATH_INFO: `/v3/projects/2a06dab7f53d450b855338d052303970` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:26.502207 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95dd3e-e496-4047-b5e7-708bb58c6375 None admin] RBAC: Authorizing `identity:get_project(project_id=2a06dab7f53d450b855338d052303970)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:26.503681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95dd3e-e496-4047-b5e7-708bb58c6375 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:26.505550 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 220/443] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:26 2022] GET /identity/v3/projects/2a06dab7f53d450b855338d052303970 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:26.511008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95dd3e-e496-4047-b5e7-708bb58c6375 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:26.529117 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:26.552731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f148de5-994d-45ad-b115-a70132c6ad96 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:26.595042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b2b16-c6ce-4d6a-af0e-41063d702c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:26.595854 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2b16-c6ce-4d6a-af0e-41063d702c71 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:26.596160 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2b16-c6ce-4d6a-af0e-41063d702c71 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:26.596546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2b16-c6ce-4d6a-af0e-41063d702c71 None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:26.597645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b2b16-c6ce-4d6a-af0e-41063d702c71 None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:26.599626 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b2b16-c6ce-4d6a-af0e-41063d702c71 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:26.600894 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 224/444] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:26 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:26.606849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b2b16-c6ce-4d6a-af0e-41063d702c71 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:26.633109 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95dd3e-e496-4047-b5e7-708bb58c6375 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:26.661835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:26.668030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ecd40-08f3-4013-87c5-2145c9198a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:26.668774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ecd40-08f3-4013-87c5-2145c9198a5c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:26.669062 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ecd40-08f3-4013-87c5-2145c9198a5c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:26.669339 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ecd40-08f3-4013-87c5-2145c9198a5c None admin] PATH_INFO: `/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:26.670568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ecd40-08f3-4013-87c5-2145c9198a5c None admin] RBAC: Authorizing `identity:get_group(group_id=ee750fd64f0f4b8ca42e4dfc857f7f00)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:26.671984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ecd40-08f3-4013-87c5-2145c9198a5c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:26.674155 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 221/445] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:26 2022] GET /identity/v3/groups/ee750fd64f0f4b8ca42e4dfc857f7f00 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:26.680652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ecd40-08f3-4013-87c5-2145c9198a5c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:26.728280 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b2b16-c6ce-4d6a-af0e-41063d702c71 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:26.770160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:26.773749 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6eb3-1a20-434a-a9be-1788c0d78144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:26.775155 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6eb3-1a20-434a-a9be-1788c0d78144 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:26.775437 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6eb3-1a20-434a-a9be-1788c0d78144 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:26.775710 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6eb3-1a20-434a-a9be-1788c0d78144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:26.776566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f6eb3-1a20-434a-a9be-1788c0d78144 None admin] RBAC: Adding query filter params (group.id=ee750fd64f0f4b8ca42e4dfc857f7f00, role.id=a2eb0e476c1f497888d73bb1d1771d16, scope.project.id=2a06dab7f53d450b855338d052303970) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:26.776883 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f6eb3-1a20-434a-a9be-1788c0d78144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:26.778435 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f6eb3-1a20-434a-a9be-1788c0d78144 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:26.794547 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 225/446] 10.222.0.73 () {56 vars in 1376 bytes} [Wed Jul 27 17:52:26 2022] GET /identity/v3/role_assignments?group.id=ee750fd64f0f4b8ca42e4dfc857f7f00&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=a2eb0e476c1f497888d73bb1d1771d16 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:26.799606 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ecd40-08f3-4013-87c5-2145c9198a5c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:26.840165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412173e-7e2d-4f62-a5e1-1096eab848aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:26.840802 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412173e-7e2d-4f62-a5e1-1096eab848aa None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:26.841087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412173e-7e2d-4f62-a5e1-1096eab848aa None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:26.841362 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412173e-7e2d-4f62-a5e1-1096eab848aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:26.842174 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412173e-7e2d-4f62-a5e1-1096eab848aa None admin] RBAC: Adding query filter params (group.id=ee750fd64f0f4b8ca42e4dfc857f7f00, role.id=4ff7ba49d92f490cba2d9ef2f9a36e79, scope.project.id=2a06dab7f53d450b855338d052303970) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:26.842488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412173e-7e2d-4f62-a5e1-1096eab848aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:26.844012 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412173e-7e2d-4f62-a5e1-1096eab848aa None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:26.852655 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 222/447] 10.222.0.73 () {56 vars in 1376 bytes} [Wed Jul 27 17:52:26 2022] GET /identity/v3/role_assignments?group.id=ee750fd64f0f4b8ca42e4dfc857f7f00&scope.project.id=2a06dab7f53d450b855338d052303970&role.id=4ff7ba49d92f490cba2d9ef2f9a36e79 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:26.899353 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c352-06f3-4333-8933-f9230b815bd3 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:26.899653 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c352-06f3-4333-8933-f9230b815bd3 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:26.900087 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c352-06f3-4333-8933-f9230b815bd3 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:26.901652 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 226/448] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:26.907404 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca3676-2def-4ded-ac27-11f496d6be8a None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:26.908419 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca3676-2def-4ded-ac27-11f496d6be8a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:26.908867 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca3676-2def-4ded-ac27-11f496d6be8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:26.928941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-33ca3676-2def-4ded-ac27-11f496d6be8a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:26.930212 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-33ca3676-2def-4ded-ac27-11f496d6be8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:27.016011 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 223/449] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:27.042373 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589c352-06f3-4333-8933-f9230b815bd3 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:27.168541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589c352-06f3-4333-8933-f9230b815bd3 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:27.181892 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:27.204172 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ed420-ac8f-4d25-826e-25c62ddf1042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:27.205513 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ed420-ac8f-4d25-826e-25c62ddf1042 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:27.205803 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ed420-ac8f-4d25-826e-25c62ddf1042 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:27.206079 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ed420-ac8f-4d25-826e-25c62ddf1042 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:27.216502 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ed420-ac8f-4d25-826e-25c62ddf1042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-999ed420-ac8f-4d25-826e-25c62ddf1042 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:27.222342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:27.223546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:27.224520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 227/450] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:52:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:27.229622 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca3676-2def-4ded-ac27-11f496d6be8a None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:27.316348 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:27.341784 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca3676-2def-4ded-ac27-11f496d6be8a None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:27.377619 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615a6ed-7ca1-4ce8-8e21-b4b520ec6b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:27.378315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a6ed-7ca1-4ce8-8e21-b4b520ec6b24 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:27.378633 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a6ed-7ca1-4ce8-8e21-b4b520ec6b24 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:27.378908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a6ed-7ca1-4ce8-8e21-b4b520ec6b24 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:27.379627 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615a6ed-7ca1-4ce8-8e21-b4b520ec6b24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:27.379934 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615a6ed-7ca1-4ce8-8e21-b4b520ec6b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:27.381303 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615a6ed-7ca1-4ce8-8e21-b4b520ec6b24 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:27.389210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 224/451] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:27.395815 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ed420-ac8f-4d25-826e-25c62ddf1042 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:27.498189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ed420-ac8f-4d25-826e-25c62ddf1042 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:27.531140 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364305f-6c27-4e0d-b339-bb1d1114c8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:27.531754 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364305f-6c27-4e0d-b339-bb1d1114c8dc None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:27.532039 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364305f-6c27-4e0d-b339-bb1d1114c8dc None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:27.532318 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364305f-6c27-4e0d-b339-bb1d1114c8dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:27.574131 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:27.600825 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364305f-6c27-4e0d-b339-bb1d1114c8dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:27.602291 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364305f-6c27-4e0d-b339-bb1d1114c8dc None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:27.698369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 228/452] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:27.704101 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615a6ed-7ca1-4ce8-8e21-b4b520ec6b24 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:27.803194 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615a6ed-7ca1-4ce8-8e21-b4b520ec6b24 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:27.836524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1ef7-06ed-4d81-96fb-7d1d34e4572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:27.837369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1ef7-06ed-4d81-96fb-7d1d34e4572c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:27.837647 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1ef7-06ed-4d81-96fb-7d1d34e4572c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:27.837919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1ef7-06ed-4d81-96fb-7d1d34e4572c None admin] PATH_INFO: `/v3/projects/62c6a98aca8a4b2da0a78051d92a86b2` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:27.839101 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a1ef7-06ed-4d81-96fb-7d1d34e4572c None admin] RBAC: Authorizing `identity:get_project(project_id=62c6a98aca8a4b2da0a78051d92a86b2)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:27.840755 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a1ef7-06ed-4d81-96fb-7d1d34e4572c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:27.842621 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 225/453] 10.222.0.73 () {56 vars in 1186 bytes} [Wed Jul 27 17:52:27 2022] GET /identity/v3/projects/62c6a98aca8a4b2da0a78051d92a86b2 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:27.850992 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364305f-6c27-4e0d-b339-bb1d1114c8dc None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:27.918708 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:27.947364 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364305f-6c27-4e0d-b339-bb1d1114c8dc None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:27.980045 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdd6e5-a477-46d0-b4db-ef74527007c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:27.980671 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd6e5-a477-46d0-b4db-ef74527007c2 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:27.980949 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd6e5-a477-46d0-b4db-ef74527007c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:27.981219 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd6e5-a477-46d0-b4db-ef74527007c2 None admin] PATH_INFO: `/v3/groups/4293dc40edac47f2b88092924f832d0c` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:27.982350 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdd6e5-a477-46d0-b4db-ef74527007c2 None admin] RBAC: Authorizing `identity:get_group(group_id=4293dc40edac47f2b88092924f832d0c)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:27.983825 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdd6e5-a477-46d0-b4db-ef74527007c2 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:27.985389 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 229/454] 10.222.0.73 () {56 vars in 1180 bytes} [Wed Jul 27 17:52:27 2022] GET /identity/v3/groups/4293dc40edac47f2b88092924f832d0c => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:27.991992 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1ef7-06ed-4d81-96fb-7d1d34e4572c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:28.001093 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:28.091886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1ef7-06ed-4d81-96fb-7d1d34e4572c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:28.125272 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9e409-a5ff-40c5-89b6-5a7f580eea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:28.125879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9e409-a5ff-40c5-89b6-5a7f580eea30 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:28.126162 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9e409-a5ff-40c5-89b6-5a7f580eea30 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:28.126527 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9e409-a5ff-40c5-89b6-5a7f580eea30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:28.127530 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9e409-a5ff-40c5-89b6-5a7f580eea30 None admin] RBAC: Adding query filter params (group.id=4293dc40edac47f2b88092924f832d0c, role.id=d6d0c56d1054455c813546a2c761a7d0, scope.project.id=62c6a98aca8a4b2da0a78051d92a86b2) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:28.127843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9e409-a5ff-40c5-89b6-5a7f580eea30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:28.129274 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9e409-a5ff-40c5-89b6-5a7f580eea30 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:28.135195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 226/455] 10.222.0.73 () {56 vars in 1376 bytes} [Wed Jul 27 17:52:27 2022] GET /identity/v3/role_assignments?group.id=4293dc40edac47f2b88092924f832d0c&scope.project.id=62c6a98aca8a4b2da0a78051d92a86b2&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:30.750940 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9eb3d-fc0b-4da4-ad21-347b8d337ee5 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:30.751520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9eb3d-fc0b-4da4-ad21-347b8d337ee5 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:30.751598 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9eb3d-fc0b-4da4-ad21-347b8d337ee5 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:30.753052 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 230/456] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:30.758868 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6033d9-cd85-4e61-8ee8-efddb0639055 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:30.759741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6033d9-cd85-4e61-8ee8-efddb0639055 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:30.760243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6033d9-cd85-4e61-8ee8-efddb0639055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:30.779288 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-bd6033d9-cd85-4e61-8ee8-efddb0639055 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:30.780853 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-bd6033d9-cd85-4e61-8ee8-efddb0639055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:30.837367 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ca663-8d8c-4c0d-bc9e-106ec182f33d None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:30.837678 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ca663-8d8c-4c0d-bc9e-106ec182f33d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:30.837926 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ca663-8d8c-4c0d-bc9e-106ec182f33d None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:30.840601 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 231/457] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:30.844647 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b0f37-ca13-4ebf-895e-a822b1415c15 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:30.844931 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b0f37-ca13-4ebf-895e-a822b1415c15 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:30.845924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b0f37-ca13-4ebf-895e-a822b1415c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:30.870556 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 227/458] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:30.870928 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:30.873660 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-791b0f37-ca13-4ebf-895e-a822b1415c15 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:30.875150 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-791b0f37-ca13-4ebf-895e-a822b1415c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:30.894401 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6033d9-cd85-4e61-8ee8-efddb0639055 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:30.976159 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 232/459] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:30.979360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f8d7d-27de-46d8-b880-23673059f2c2 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:30.979651 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f8d7d-27de-46d8-b880-23673059f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:30.979926 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f8d7d-27de-46d8-b880-23673059f2c2 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:30.981455 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 233/460] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:30.986470 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99690d6-8cf6-459c-beb7-b0006b63e78d None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:30.986765 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99690d6-8cf6-459c-beb7-b0006b63e78d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:30.987042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99690d6-8cf6-459c-beb7-b0006b63e78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:31.006293 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-b99690d6-8cf6-459c-beb7-b0006b63e78d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:31.007432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-b99690d6-8cf6-459c-beb7-b0006b63e78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:31.011682 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6033d9-cd85-4e61-8ee8-efddb0639055 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:31.048786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb91ec3-2d72-45b8-a260-84fc2c4b0e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:31.049826 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91ec3-2d72-45b8-a260-84fc2c4b0e86 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:31.050313 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91ec3-2d72-45b8-a260-84fc2c4b0e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:31.050839 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91ec3-2d72-45b8-a260-84fc2c4b0e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:31.062391 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb91ec3-2d72-45b8-a260-84fc2c4b0e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:31.064503 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb91ec3-2d72-45b8-a260-84fc2c4b0e86 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:31.077680 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:31.083241 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 234/461] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:31.084156 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99690d6-8cf6-459c-beb7-b0006b63e78d None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-0bb91ec3-2d72-45b8-a260-84fc2c4b0e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:31.084521 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:31.085568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:31.086681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:31.086681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:31.086681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:31.086681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:31.088206 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 228/462] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:31.094947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb91ec3-2d72-45b8-a260-84fc2c4b0e86 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:31.162868 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:31.196401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99690d6-8cf6-459c-beb7-b0006b63e78d None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:31.218354 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb91ec3-2d72-45b8-a260-84fc2c4b0e86 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:31.234908 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b11c94-7c3f-45f9-824c-6ce1b24966ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:31.236418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11c94-7c3f-45f9-824c-6ce1b24966ba None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:31.236879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11c94-7c3f-45f9-824c-6ce1b24966ba None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:31.237328 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11c94-7c3f-45f9-824c-6ce1b24966ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:31.248522 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b11c94-7c3f-45f9-824c-6ce1b24966ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:31.250423 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b11c94-7c3f-45f9-824c-6ce1b24966ba None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:31.255204 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f740cf-b35a-4481-a748-cd37276e037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:31.255827 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f740cf-b35a-4481-a748-cd37276e037f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:31.256107 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f740cf-b35a-4481-a748-cd37276e037f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:31.256438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f740cf-b35a-4481-a748-cd37276e037f None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:31.257073 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f740cf-b35a-4481-a748-cd37276e037f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:31.257377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f740cf-b35a-4481-a748-cd37276e037f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:31.258781 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f740cf-b35a-4481-a748-cd37276e037f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-86b11c94-7c3f-45f9-824c-6ce1b24966ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:31.269158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:31.270213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:31.271197 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:31.271197 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:31.271197 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:31.271197 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:31.276851 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 235/463] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:31.276851 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b11c94-7c3f-45f9-824c-6ce1b24966ba None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:31.281392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 229/464] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:31.281392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f740cf-b35a-4481-a748-cd37276e037f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:31.337628 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:31.387111 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b11c94-7c3f-45f9-824c-6ce1b24966ba None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:31.391290 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f740cf-b35a-4481-a748-cd37276e037f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:31.405611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:31.421681 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5857c-fd49-446c-872c-28f6417bc567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:31.422314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5857c-fd49-446c-872c-28f6417bc567 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:31.422630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5857c-fd49-446c-872c-28f6417bc567 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:31.422958 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5857c-fd49-446c-872c-28f6417bc567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:31.427735 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be582c0a-7306-4823-868c-c9999221dbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:31.428360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be582c0a-7306-4823-868c-c9999221dbc0 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:31.428635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be582c0a-7306-4823-868c-c9999221dbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:31.428907 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be582c0a-7306-4823-868c-c9999221dbc0 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:31.429599 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be582c0a-7306-4823-868c-c9999221dbc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:31.429901 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be582c0a-7306-4823-868c-c9999221dbc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:31.431301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be582c0a-7306-4823-868c-c9999221dbc0 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:31.435747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5857c-fd49-446c-872c-28f6417bc567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:31.437247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5857c-fd49-446c-872c-28f6417bc567 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:31.442775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 230/465] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:31.443590 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be582c0a-7306-4823-868c-c9999221dbc0 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-eca5857c-fd49-446c-872c-28f6417bc567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:31.452146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:31.453005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:31.453907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:31.453907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:31.453907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:31.453907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:31.453907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 236/466] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:31.455135 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f28f-fe3d-4fac-b73e-dcecda0b173b None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:31.456471 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f28f-fe3d-4fac-b73e-dcecda0b173b None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:31.456471 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f28f-fe3d-4fac-b73e-dcecda0b173b None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:31.462722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 237/467] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:31.462722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15f28f-fe3d-4fac-b73e-dcecda0b173b None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:31.553066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be582c0a-7306-4823-868c-c9999221dbc0 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:31.562132 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15f28f-fe3d-4fac-b73e-dcecda0b173b None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:31.564546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:31.587578 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84a931-eb56-4816-b238-433e38d1118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:31.588206 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a931-eb56-4816-b238-433e38d1118a None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:31.588491 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a931-eb56-4816-b238-433e38d1118a None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:31.588772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a931-eb56-4816-b238-433e38d1118a None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:31.589454 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84a931-eb56-4816-b238-433e38d1118a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:31.590943 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84a931-eb56-4816-b238-433e38d1118a None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:31.596890 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0472a-4ca7-4f99-b725-25a07c0ecfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:31.597503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0472a-4ca7-4f99-b725-25a07c0ecfcd None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:31.597841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0472a-4ca7-4f99-b725-25a07c0ecfcd None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:31.598126 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0472a-4ca7-4f99-b725-25a07c0ecfcd None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:31.598834 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0472a-4ca7-4f99-b725-25a07c0ecfcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:31.600262 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0472a-4ca7-4f99-b725-25a07c0ecfcd None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:31.615135 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 231/468] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:52:31 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:52:31.616041 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84a931-eb56-4816-b238-433e38d1118a None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:31.624242 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 238/469] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:52:31 2022] POST /identity/v3/users => generated 248 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:52:31.625728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ecce-da80-41e1-9f52-a272c9a707a0 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:31.626602 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ecce-da80-41e1-9f52-a272c9a707a0 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:31.627254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ecce-da80-41e1-9f52-a272c9a707a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:31.656428 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:31.660018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-25c6ecce-da80-41e1-9f52-a272c9a707a0 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:31.661613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-25c6ecce-da80-41e1-9f52-a272c9a707a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:31.751781 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84a931-eb56-4816-b238-433e38d1118a None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:31.768763 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 239/470] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:31.790490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6ecce-da80-41e1-9f52-a272c9a707a0 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:31.798431 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbb60e-c1f2-412f-9ec8-1e53ae294b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:31.799662 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbb60e-c1f2-412f-9ec8-1e53ae294b3e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:31.799662 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbb60e-c1f2-412f-9ec8-1e53ae294b3e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:31.800067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbb60e-c1f2-412f-9ec8-1e53ae294b3e None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:31.801274 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbb60e-c1f2-412f-9ec8-1e53ae294b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:31.801274 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbb60e-c1f2-412f-9ec8-1e53ae294b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:31.802836 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbb60e-c1f2-412f-9ec8-1e53ae294b3e None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:31.818452 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 232/471] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:31.825159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbb60e-c1f2-412f-9ec8-1e53ae294b3e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:31.939888 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:31.951539 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6ecce-da80-41e1-9f52-a272c9a707a0 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:31.975476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbb60e-c1f2-412f-9ec8-1e53ae294b3e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:31.978479 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:31.994658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f697-5aa7-4858-9542-377591b05834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:31.995893 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f697-5aa7-4858-9542-377591b05834 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:31.996610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f697-5aa7-4858-9542-377591b05834 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:31.997035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f697-5aa7-4858-9542-377591b05834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:32.012546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040f697-5aa7-4858-9542-377591b05834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:32.014008 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040f697-5aa7-4858-9542-377591b05834 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:32.018737 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5f41f-2a84-4a9d-b221-ba6883b267f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:32.019460 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f41f-2a84-4a9d-b221-ba6883b267f1 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:32.019636 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f41f-2a84-4a9d-b221-ba6883b267f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:32.019894 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f41f-2a84-4a9d-b221-ba6883b267f1 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:32.020577 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5f41f-2a84-4a9d-b221-ba6883b267f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:32.021997 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5f41f-2a84-4a9d-b221-ba6883b267f1 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-c040f697-5aa7-4858-9542-377591b05834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:32.037100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:32.038030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:32.038942 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:32.038942 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:32.038942 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:32.038942 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:32.040744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 240/472] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:32.046754 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f697-5aa7-4858-9542-377591b05834 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:32.049155 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 233/473] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:52:31 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 17:52:32.176754 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f697-5aa7-4858-9542-377591b05834 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:32.216287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148c301-c9b5-48bd-aba4-269da5b1d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:32.216982 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148c301-c9b5-48bd-aba4-269da5b1d13b None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:32.217262 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148c301-c9b5-48bd-aba4-269da5b1d13b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:32.217589 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148c301-c9b5-48bd-aba4-269da5b1d13b None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:32.218315 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148c301-c9b5-48bd-aba4-269da5b1d13b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:32.218659 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148c301-c9b5-48bd-aba4-269da5b1d13b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:32.220090 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148c301-c9b5-48bd-aba4-269da5b1d13b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:32.234213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 241/474] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:32.240411 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5f41f-2a84-4a9d-b221-ba6883b267f1 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:32.355205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5f41f-2a84-4a9d-b221-ba6883b267f1 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:32.393179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5cb95-4b57-45da-9ac9-50781e144cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:32.393853 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5cb95-4b57-45da-9ac9-50781e144cd3 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:32.394137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5cb95-4b57-45da-9ac9-50781e144cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:32.394412 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5cb95-4b57-45da-9ac9-50781e144cd3 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:32.395152 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5cb95-4b57-45da-9ac9-50781e144cd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:32.396602 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5cb95-4b57-45da-9ac9-50781e144cd3 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:32.416236 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:32.421994 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 234/475] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:52:32 2022] POST /identity/v3/users => generated 249 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:52:34.026976 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2e91-141b-43ae-8d55-9dddbc389ea7 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.027667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2e91-141b-43ae-8d55-9dddbc389ea7 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.027667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2e91-141b-43ae-8d55-9dddbc389ea7 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.029141 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 242/476] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:34.035085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3f22-7463-4bef-961e-8783d9bb16b1 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.035613 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3f22-7463-4bef-961e-8783d9bb16b1 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.035613 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3f22-7463-4bef-961e-8783d9bb16b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.047495 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538277ae-abc3-4145-b64e-45fab778fa46 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.048106 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538277ae-abc3-4145-b64e-45fab778fa46 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.048851 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538277ae-abc3-4145-b64e-45fab778fa46 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.050777 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 243/477] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:34.056726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c5fcb-bbbb-4d11-975c-160db288606c None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.057335 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c5fcb-bbbb-4d11-975c-160db288606c None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.057841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c5fcb-bbbb-4d11-975c-160db288606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.061947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-1f1d3f22-7463-4bef-961e-8783d9bb16b1 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:34.063193 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-1f1d3f22-7463-4bef-961e-8783d9bb16b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:34.065789 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:34.083191 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-b33c5fcb-bbbb-4d11-975c-160db288606c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:34.084757 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-b33c5fcb-bbbb-4d11-975c-160db288606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:34.151250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 235/478] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:34.179234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 244/479] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:34.179417 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d3f22-7463-4bef-961e-8783d9bb16b1 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:34.209191 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c5fcb-bbbb-4d11-975c-160db288606c None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:34.306912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d3f22-7463-4bef-961e-8783d9bb16b1 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:34.332151 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c5fcb-bbbb-4d11-975c-160db288606c None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:34.340571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:34.349067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313118-a063-4cb0-8cc0-b762d989b428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:34.350165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313118-a063-4cb0-8cc0-b762d989b428 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.350721 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313118-a063-4cb0-8cc0-b762d989b428 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.351204 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313118-a063-4cb0-8cc0-b762d989b428 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.364815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a313118-a063-4cb0-8cc0-b762d989b428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-3a313118-a063-4cb0-8cc0-b762d989b428 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:34.371003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:34.371980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:34.372780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:34.374792 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:34.376672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 236/480] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:34.383054 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313118-a063-4cb0-8cc0-b762d989b428 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:34.385559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739639-071d-451c-87f6-d0d594af8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:34.386465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739639-071d-451c-87f6-d0d594af8920 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.387056 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739639-071d-451c-87f6-d0d594af8920 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.387559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739639-071d-451c-87f6-d0d594af8920 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.399938 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13739639-071d-451c-87f6-d0d594af8920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-13739639-071d-451c-87f6-d0d594af8920 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:34.405498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:34.406401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:34.407287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:34.414618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 245/481] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:34.416643 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739639-071d-451c-87f6-d0d594af8920 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:34.505413 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313118-a063-4cb0-8cc0-b762d989b428 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:34.535641 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739639-071d-451c-87f6-d0d594af8920 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:34.546326 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c5b20-73ae-4b20-a1a9-10ff2fd8f7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:34.546895 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c5b20-73ae-4b20-a1a9-10ff2fd8f7f0 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.547175 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c5b20-73ae-4b20-a1a9-10ff2fd8f7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.547452 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c5b20-73ae-4b20-a1a9-10ff2fd8f7f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.548578 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c5b20-73ae-4b20-a1a9-10ff2fd8f7f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:34.548898 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c5b20-73ae-4b20-a1a9-10ff2fd8f7f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:34.550310 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c5b20-73ae-4b20-a1a9-10ff2fd8f7f0 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:34.568415 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 237/482] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:34.568415 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c9bc7-4f0d-4b3a-95bc-cc98fa938912 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.568415 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c9bc7-4f0d-4b3a-95bc-cc98fa938912 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.568415 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c9bc7-4f0d-4b3a-95bc-cc98fa938912 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.568415 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 238/483] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:34.571723 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c9bc7-4f0d-4b3a-95bc-cc98fa938912 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:34.585685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10c28a-4a1d-4979-91d4-9914f298f911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:34.586409 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10c28a-4a1d-4979-91d4-9914f298f911 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.586724 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10c28a-4a1d-4979-91d4-9914f298f911 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.587003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10c28a-4a1d-4979-91d4-9914f298f911 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.587727 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10c28a-4a1d-4979-91d4-9914f298f911 None admin] RBAC: Adding query filter params (name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:34.588034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10c28a-4a1d-4979-91d4-9914f298f911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:34.589669 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10c28a-4a1d-4979-91d4-9914f298f911 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:34.599566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 246/484] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:34.600974 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32e203-4a7d-45c7-898d-65223eb772c3 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.601328 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32e203-4a7d-45c7-898d-65223eb772c3 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.601614 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32e203-4a7d-45c7-898d-65223eb772c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.623235 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-3c32e203-4a7d-45c7-898d-65223eb772c3 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:34.624899 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-3c32e203-4a7d-45c7-898d-65223eb772c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:34.636176 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:34.688076 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:34.695210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c9bc7-4f0d-4b3a-95bc-cc98fa938912 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:34.708191 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 247/485] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:34.708877 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32e203-4a7d-45c7-898d-65223eb772c3 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:34.740341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fe535-5ca4-411c-a73e-c4eb5575694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:34.740992 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fe535-5ca4-411c-a73e-c4eb5575694a None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.741281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fe535-5ca4-411c-a73e-c4eb5575694a None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.741562 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fe535-5ca4-411c-a73e-c4eb5575694a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.752412 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fe535-5ca4-411c-a73e-c4eb5575694a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:34.753890 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fe535-5ca4-411c-a73e-c4eb5575694a None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-3b8fe535-5ca4-411c-a73e-c4eb5575694a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:34.770205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:34.771355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:34.772410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:34.772410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:34.772410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:34.772410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:34.776393 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 239/486] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:34.777272 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fe535-5ca4-411c-a73e-c4eb5575694a None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:34.828191 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32e203-4a7d-45c7-898d-65223eb772c3 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:34.862899 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06264cd-b7d8-4957-b6fe-85a94e4d0512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:34.863543 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06264cd-b7d8-4957-b6fe-85a94e4d0512 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.863819 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06264cd-b7d8-4957-b6fe-85a94e4d0512 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.864092 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06264cd-b7d8-4957-b6fe-85a94e4d0512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.874588 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06264cd-b7d8-4957-b6fe-85a94e4d0512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:34.876091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06264cd-b7d8-4957-b6fe-85a94e4d0512 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:34.884475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fe535-5ca4-411c-a73e-c4eb5575694a None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:34.887356 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-a06264cd-b7d8-4957-b6fe-85a94e4d0512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:34.891298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:34.892990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:34.893866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:34.893866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:34.893866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:34.893866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:34.893866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 248/487] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:34.894141 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06264cd-b7d8-4957-b6fe-85a94e4d0512 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:34.921738 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c95d84-6180-4165-a92e-37a8f9eb37be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:34.922379 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c95d84-6180-4165-a92e-37a8f9eb37be None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.922706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c95d84-6180-4165-a92e-37a8f9eb37be None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.922980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c95d84-6180-4165-a92e-37a8f9eb37be None admin] PATH_INFO: `/v3/roles/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.930732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:34.934910 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c95d84-6180-4165-a92e-37a8f9eb37be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-94c95d84-6180-4165-a92e-37a8f9eb37be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:34.941531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:34.942488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:34.943376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 240/488] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:34.944046 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33045c-e82d-4bba-95c3-136a9513d083 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:34.944697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33045c-e82d-4bba-95c3-136a9513d083 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:34.944697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33045c-e82d-4bba-95c3-136a9513d083 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:34.945845 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 241/489] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:34.946408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33045c-e82d-4bba-95c3-136a9513d083 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.006051 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06264cd-b7d8-4957-b6fe-85a94e4d0512 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.039993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f0381-3c0d-4ffb-b1d9-51409498f5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:35.040665 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f0381-3c0d-4ffb-b1d9-51409498f5b6 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.040896 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f0381-3c0d-4ffb-b1d9-51409498f5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.041172 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f0381-3c0d-4ffb-b1d9-51409498f5b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.041875 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f0381-3c0d-4ffb-b1d9-51409498f5b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:35.042179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f0381-3c0d-4ffb-b1d9-51409498f5b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:35.043617 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f0381-3c0d-4ffb-b1d9-51409498f5b6 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:35.056329 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 249/490] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:35.057171 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f0381-3c0d-4ffb-b1d9-51409498f5b6 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.058647 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33045c-e82d-4bba-95c3-136a9513d083 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.094548 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bacad-d529-49c8-b133-bb561e891730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:35.095157 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bacad-d529-49c8-b133-bb561e891730 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.095445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bacad-d529-49c8-b133-bb561e891730 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.095722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bacad-d529-49c8-b133-bb561e891730 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.096408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bacad-d529-49c8-b133-bb561e891730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:35.096713 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bacad-d529-49c8-b133-bb561e891730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:35.098090 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bacad-d529-49c8-b133-bb561e891730 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:35.109789 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 242/491] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:35.111689 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb4434-5998-4679-920f-5a5c8d506643 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.111974 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb4434-5998-4679-920f-5a5c8d506643 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.112245 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb4434-5998-4679-920f-5a5c8d506643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.129843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-77bb4434-5998-4679-920f-5a5c8d506643 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:35.131060 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-77bb4434-5998-4679-920f-5a5c8d506643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:35.149355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:35.158498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:35.165313 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f0381-3c0d-4ffb-b1d9-51409498f5b6 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.198994 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f891ee-6bed-45dc-8bc1-8265d6722619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:35.199544 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 243/492] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:35.199669 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f891ee-6bed-45dc-8bc1-8265d6722619 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.199879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f891ee-6bed-45dc-8bc1-8265d6722619 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.200150 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f891ee-6bed-45dc-8bc1-8265d6722619 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.200388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb4434-5998-4679-920f-5a5c8d506643 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.200861 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f891ee-6bed-45dc-8bc1-8265d6722619 None admin] RBAC: Adding query filter params (name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:35.201214 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f891ee-6bed-45dc-8bc1-8265d6722619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:35.202540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f891ee-6bed-45dc-8bc1-8265d6722619 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:35.211165 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 250/493] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:35.211954 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f891ee-6bed-45dc-8bc1-8265d6722619 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.308190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb4434-5998-4679-920f-5a5c8d506643 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.313406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f891ee-6bed-45dc-8bc1-8265d6722619 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.341826 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af459e-9a54-4364-8613-97e3dc3d407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:35.342605 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af459e-9a54-4364-8613-97e3dc3d407f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.342896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af459e-9a54-4364-8613-97e3dc3d407f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.343171 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af459e-9a54-4364-8613-97e3dc3d407f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.347720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5c8e-422b-4c2c-8c00-95f4a3aa8155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:35.348303 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5c8e-422b-4c2c-8c00-95f4a3aa8155 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.348587 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5c8e-422b-4c2c-8c00-95f4a3aa8155 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.348866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5c8e-422b-4c2c-8c00-95f4a3aa8155 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.350928 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af459e-9a54-4364-8613-97e3dc3d407f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:35.352349 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af459e-9a54-4364-8613-97e3dc3d407f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:35.356431 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f5c8e-422b-4c2c-8c00-95f4a3aa8155 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:35.357859 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f5c8e-422b-4c2c-8c00-95f4a3aa8155 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-53af459e-9a54-4364-8613-97e3dc3d407f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:35.366653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:35.367571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:35.368483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:35.368483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:35.368483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:35.368483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:35.368483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:35.368483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:35.368483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:35.368483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:35.368483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:52:35.368483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:35.368483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 244/494] 10.222.0.73 () {56 vars in 1093 bytes} [Wed Jul 27 17:52:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:35.369338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af459e-9a54-4364-8613-97e3dc3d407f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-e45f5c8e-422b-4c2c-8c00-95f4a3aa8155 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:35.371081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:35.372657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 251/495] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:35.375610 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5c8e-422b-4c2c-8c00-95f4a3aa8155 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.388792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:35.398903 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:35.478083 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af459e-9a54-4364-8613-97e3dc3d407f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.482146 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5c8e-422b-4c2c-8c00-95f4a3aa8155 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.512322 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be9938-8ccd-47a6-b16c-fff3f64a162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:35.512961 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9938-8ccd-47a6-b16c-fff3f64a162e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.513238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9938-8ccd-47a6-b16c-fff3f64a162e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.513508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9938-8ccd-47a6-b16c-fff3f64a162e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.518658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33e402-4ec2-4b49-bada-1e3e5a77ca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:35.519299 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e402-4ec2-4b49-bada-1e3e5a77ca26 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.519579 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e402-4ec2-4b49-bada-1e3e5a77ca26 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.519853 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e402-4ec2-4b49-bada-1e3e5a77ca26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.524557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be9938-8ccd-47a6-b16c-fff3f64a162e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:35.526278 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be9938-8ccd-47a6-b16c-fff3f64a162e None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:35.530468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33e402-4ec2-4b49-bada-1e3e5a77ca26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-7f33e402-4ec2-4b49-bada-1e3e5a77ca26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:35.536644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:35.537600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:35.538406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 252/496] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:35.539538 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33e402-4ec2-4b49-bada-1e3e5a77ca26 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-91be9938-8ccd-47a6-b16c-fff3f64a162e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:35.541965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:35.543027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:35.543886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:35.543886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:35.543886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:35.543886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:35.543886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 245/497] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:35.544155 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be9938-8ccd-47a6-b16c-fff3f64a162e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.611820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:35.621835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:35.643717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33e402-4ec2-4b49-bada-1e3e5a77ca26 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.646966 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be9938-8ccd-47a6-b16c-fff3f64a162e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.678057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328312bb-8441-400a-ad95-292f9b6b60e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:35.678708 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328312bb-8441-400a-ad95-292f9b6b60e8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.678987 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328312bb-8441-400a-ad95-292f9b6b60e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.679261 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328312bb-8441-400a-ad95-292f9b6b60e8 None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.680048 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328312bb-8441-400a-ad95-292f9b6b60e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:35.680182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dec1a-7658-4046-a976-e6102e4102b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:35.680351 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328312bb-8441-400a-ad95-292f9b6b60e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:35.680790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dec1a-7658-4046-a976-e6102e4102b7 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.681072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dec1a-7658-4046-a976-e6102e4102b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.681345 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dec1a-7658-4046-a976-e6102e4102b7 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.681794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328312bb-8441-400a-ad95-292f9b6b60e8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:35.682131 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dec1a-7658-4046-a976-e6102e4102b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:35.682435 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dec1a-7658-4046-a976-e6102e4102b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:35.683915 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dec1a-7658-4046-a976-e6102e4102b7 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:35.719387 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 253/498] 10.222.0.73 () {56 vars in 1133 bytes} [Wed Jul 27 17:52:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:35.719706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 246/499] 10.222.0.73 () {56 vars in 1137 bytes} [Wed Jul 27 17:52:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:35.720540 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dec1a-7658-4046-a976-e6102e4102b7 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.720766 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328312bb-8441-400a-ad95-292f9b6b60e8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.826852 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328312bb-8441-400a-ad95-292f9b6b60e8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.834105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dec1a-7658-4046-a976-e6102e4102b7 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.859255 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:35.862497 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7054102-5d05-4a9d-9516-2ffb8f3fcc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:35.863121 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7054102-5d05-4a9d-9516-2ffb8f3fcc64 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.863412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7054102-5d05-4a9d-9516-2ffb8f3fcc64 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.863697 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7054102-5d05-4a9d-9516-2ffb8f3fcc64 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.864423 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7054102-5d05-4a9d-9516-2ffb8f3fcc64 None admin] RBAC: Adding query filter params (name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:35.864728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7054102-5d05-4a9d-9516-2ffb8f3fcc64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:35.866118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7054102-5d05-4a9d-9516-2ffb8f3fcc64 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:35.868732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:35.871351 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37bb5d-69f0-4fc2-a79b-bce7df019d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:35.871967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bb5d-69f0-4fc2-a79b-bce7df019d0b None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:35.872258 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bb5d-69f0-4fc2-a79b-bce7df019d0b None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:35.872531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bb5d-69f0-4fc2-a79b-bce7df019d0b None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:35.873239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37bb5d-69f0-4fc2-a79b-bce7df019d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:35.873547 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37bb5d-69f0-4fc2-a79b-bce7df019d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:35.874965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37bb5d-69f0-4fc2-a79b-bce7df019d0b None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:35.875732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 254/500] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:35.877168 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7054102-5d05-4a9d-9516-2ffb8f3fcc64 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.895331 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 247/501] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:35.895331 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37bb5d-69f0-4fc2-a79b-bce7df019d0b None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:35.976912 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7054102-5d05-4a9d-9516-2ffb8f3fcc64 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:35.991289 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37bb5d-69f0-4fc2-a79b-bce7df019d0b None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:36.011193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac509f-c8dd-4cae-9a30-0e77ce343b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.011840 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac509f-c8dd-4cae-9a30-0e77ce343b58 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.012123 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac509f-c8dd-4cae-9a30-0e77ce343b58 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.012397 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac509f-c8dd-4cae-9a30-0e77ce343b58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:36.024502 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df63ec7-322e-4b8b-b286-f3a21a69a50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.025129 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63ec7-322e-4b8b-b286-f3a21a69a50f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.025674 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63ec7-322e-4b8b-b286-f3a21a69a50f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.025953 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63ec7-322e-4b8b-b286-f3a21a69a50f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:36.080945 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:36.081779 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:36.086657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac509f-c8dd-4cae-9a30-0e77ce343b58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:36.088337 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac509f-c8dd-4cae-9a30-0e77ce343b58 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:36.097458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df63ec7-322e-4b8b-b286-f3a21a69a50f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:36.098963 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df63ec7-322e-4b8b-b286-f3a21a69a50f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:36.186727 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 255/502] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:36.192132 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac509f-c8dd-4cae-9a30-0e77ce343b58 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:36.201633 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 248/503] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:36.202487 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df63ec7-322e-4b8b-b286-f3a21a69a50f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:36.285229 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:36.287374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:36.288999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac509f-c8dd-4cae-9a30-0e77ce343b58 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:36.303816 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df63ec7-322e-4b8b-b286-f3a21a69a50f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:36.323178 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6900ba-a875-4efc-a5a7-7759016aff09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.323818 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6900ba-a875-4efc-a5a7-7759016aff09 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.324094 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6900ba-a875-4efc-a5a7-7759016aff09 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.324368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6900ba-a875-4efc-a5a7-7759016aff09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:36.335165 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6900ba-a875-4efc-a5a7-7759016aff09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:36.336613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6900ba-a875-4efc-a5a7-7759016aff09 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:36.338193 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9de3c-5d2a-4ee3-a3d8-e1f376ecdeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.338863 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9de3c-5d2a-4ee3-a3d8-e1f376ecdeb8 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.339150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9de3c-5d2a-4ee3-a3d8-e1f376ecdeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.339428 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9de3c-5d2a-4ee3-a3d8-e1f376ecdeb8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:36.346778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9de3c-5d2a-4ee3-a3d8-e1f376ecdeb8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:36.348238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9de3c-5d2a-4ee3-a3d8-e1f376ecdeb8 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-2c6900ba-a875-4efc-a5a7-7759016aff09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:36.351393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:36.352418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:36.353318 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:36.353318 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:36.353318 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:36.353318 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:36.353318 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 256/504] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:36.353789 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6900ba-a875-4efc-a5a7-7759016aff09 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-e3f9de3c-5d2a-4ee3-a3d8-e1f376ecdeb8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:36.360223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:36.361208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:36.362188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:36.362188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:36.362188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:36.362188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:36.362188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:36.362188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:36.362188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:36.362188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:36.362188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 17:52:36.362188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:36.362188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 249/505] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:36.363456 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9de3c-5d2a-4ee3-a3d8-e1f376ecdeb8 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:36.459291 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6900ba-a875-4efc-a5a7-7759016aff09 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:36.466820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9de3c-5d2a-4ee3-a3d8-e1f376ecdeb8 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:36.494162 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcb078-beab-4dee-a3ff-5aca5e02ab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.494833 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcb078-beab-4dee-a3ff-5aca5e02ab1d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.495122 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcb078-beab-4dee-a3ff-5aca5e02ab1d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.495402 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcb078-beab-4dee-a3ff-5aca5e02ab1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:36.500267 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662f25b-ca9f-4ee0-99ab-7366c4c268a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.500904 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662f25b-ca9f-4ee0-99ab-7366c4c268a3 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.501182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662f25b-ca9f-4ee0-99ab-7366c4c268a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.502123 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662f25b-ca9f-4ee0-99ab-7366c4c268a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:36.507002 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcb078-beab-4dee-a3ff-5aca5e02ab1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:36.508462 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcb078-beab-4dee-a3ff-5aca5e02ab1d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:36.512788 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662f25b-ca9f-4ee0-99ab-7366c4c268a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:36.514215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662f25b-ca9f-4ee0-99ab-7366c4c268a3 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:36.516704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-18dcb078-beab-4dee-a3ff-5aca5e02ab1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:36.523566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:36.524607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:36.525761 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:36.525761 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:36.525761 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:36.525761 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:36.525761 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 257/506] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:36.525761 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcb078-beab-4dee-a3ff-5aca5e02ab1d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:36.528378 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-6662f25b-ca9f-4ee0-99ab-7366c4c268a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:36.532187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:36.533177 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:36.534049 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:36.534049 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:36.534049 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:36.534049 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:36.534049 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 250/507] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:36.534613 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662f25b-ca9f-4ee0-99ab-7366c4c268a3 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:36.635152 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcb078-beab-4dee-a3ff-5aca5e02ab1d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:36.637261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662f25b-ca9f-4ee0-99ab-7366c4c268a3 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:36.669385 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36aef2-a0f3-4d82-bd2e-8c7789538bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.670009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76b45d-1f14-4e9d-a392-8b179782637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.670129 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36aef2-a0f3-4d82-bd2e-8c7789538bf3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.670264 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36aef2-a0f3-4d82-bd2e-8c7789538bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.670564 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36aef2-a0f3-4d82-bd2e-8c7789538bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:36.670674 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76b45d-1f14-4e9d-a392-8b179782637e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.670868 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76b45d-1f14-4e9d-a392-8b179782637e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.671194 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76b45d-1f14-4e9d-a392-8b179782637e None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:36.671282 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36aef2-a0f3-4d82-bd2e-8c7789538bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:36.671540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36aef2-a0f3-4d82-bd2e-8c7789538bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:36.671984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76b45d-1f14-4e9d-a392-8b179782637e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:36.672291 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76b45d-1f14-4e9d-a392-8b179782637e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:36.672902 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36aef2-a0f3-4d82-bd2e-8c7789538bf3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:36.674305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76b45d-1f14-4e9d-a392-8b179782637e None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:36.684993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 258/508] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:36.685786 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36aef2-a0f3-4d82-bd2e-8c7789538bf3 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:36.696524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 251/509] 10.222.0.73 () {56 vars in 1137 bytes} [Wed Jul 27 17:52:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:36.696524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76b45d-1f14-4e9d-a392-8b179782637e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:36.750347 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:36.751030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:36.790828 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36aef2-a0f3-4d82-bd2e-8c7789538bf3 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:36.803226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76b45d-1f14-4e9d-a392-8b179782637e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:36.825871 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b8ca6-6079-4167-98cb-f8b5d8e33bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.826488 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b8ca6-6079-4167-98cb-f8b5d8e33bad None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.826804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b8ca6-6079-4167-98cb-f8b5d8e33bad None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.827083 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b8ca6-6079-4167-98cb-f8b5d8e33bad None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:36.827776 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b8ca6-6079-4167-98cb-f8b5d8e33bad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:36.828086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b8ca6-6079-4167-98cb-f8b5d8e33bad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:36.829457 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b8ca6-6079-4167-98cb-f8b5d8e33bad None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:36.836661 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86025-38c0-464e-a1db-1abbe576263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.837279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86025-38c0-464e-a1db-1abbe576263f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.837562 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86025-38c0-464e-a1db-1abbe576263f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.837846 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86025-38c0-464e-a1db-1abbe576263f None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:36.838572 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f86025-38c0-464e-a1db-1abbe576263f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:36.838892 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f86025-38c0-464e-a1db-1abbe576263f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:36.840264 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f86025-38c0-464e-a1db-1abbe576263f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:36.841057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 259/510] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:36.841839 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b8ca6-6079-4167-98cb-f8b5d8e33bad None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:36.857605 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 252/511] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:36.857605 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86025-38c0-464e-a1db-1abbe576263f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:36.943254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b8ca6-6079-4167-98cb-f8b5d8e33bad None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:36.952995 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86025-38c0-464e-a1db-1abbe576263f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:36.966198 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:36.968477 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:36.979163 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64bb4e-05b7-4541-b816-9bea55c960a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.979805 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64bb4e-05b7-4541-b816-9bea55c960a0 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.980091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64bb4e-05b7-4541-b816-9bea55c960a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.980370 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64bb4e-05b7-4541-b816-9bea55c960a0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:36.988327 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64bb4e-05b7-4541-b816-9bea55c960a0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:36.989166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70777d96-7058-44cf-9b85-d38766ef127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:36.989787 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777d96-7058-44cf-9b85-d38766ef127f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:36.989879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64bb4e-05b7-4541-b816-9bea55c960a0 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:36.990072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777d96-7058-44cf-9b85-d38766ef127f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:36.990351 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777d96-7058-44cf-9b85-d38766ef127f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-8b64bb4e-05b7-4541-b816-9bea55c960a0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:37.001267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:37.002821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:37.003733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:37.003733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:37.003733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:37.003733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:37.003733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:37.003733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:37.003733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:37.003733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:37.003733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 17:52:37.003733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:37.003733 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 260/512] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:37.005207 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64bb4e-05b7-4541-b816-9bea55c960a0 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:37.060511 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70777d96-7058-44cf-9b85-d38766ef127f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:37.061959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70777d96-7058-44cf-9b85-d38766ef127f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:37.106100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64bb4e-05b7-4541-b816-9bea55c960a0 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:37.140147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147e5de-eaf6-41d0-a81f-fdb0fb241fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:37.140786 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147e5de-eaf6-41d0-a81f-fdb0fb241fc8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:37.141070 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147e5de-eaf6-41d0-a81f-fdb0fb241fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:37.141340 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147e5de-eaf6-41d0-a81f-fdb0fb241fc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:37.148727 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147e5de-eaf6-41d0-a81f-fdb0fb241fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:37.150202 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147e5de-eaf6-41d0-a81f-fdb0fb241fc8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:37.162470 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 253/513] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-7147e5de-eaf6-41d0-a81f-fdb0fb241fc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:37.162960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:37.163808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:37.164667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:37.164667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:37.164667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:37.164667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:37.164667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:37.164667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:37.164667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:37.164667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:37.165091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70777d96-7058-44cf-9b85-d38766ef127f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:37.165160 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 261/514] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:37.165160 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147e5de-eaf6-41d0-a81f-fdb0fb241fc8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:37.183255 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:37.210116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:37.266345 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70777d96-7058-44cf-9b85-d38766ef127f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:37.266622 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147e5de-eaf6-41d0-a81f-fdb0fb241fc8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:37.300275 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927534ab-62a1-4b40-89e7-02916326bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:37.300912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927534ab-62a1-4b40-89e7-02916326bef6 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:37.301190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927534ab-62a1-4b40-89e7-02916326bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:37.301466 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927534ab-62a1-4b40-89e7-02916326bef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:37.301570 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd124a-2016-4ff6-93a9-d46d25844088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:37.302086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd124a-2016-4ff6-93a9-d46d25844088 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:37.302373 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd124a-2016-4ff6-93a9-d46d25844088 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:37.302698 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd124a-2016-4ff6-93a9-d46d25844088 None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:37.303495 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd124a-2016-4ff6-93a9-d46d25844088 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:37.303796 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd124a-2016-4ff6-93a9-d46d25844088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:37.305227 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd124a-2016-4ff6-93a9-d46d25844088 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:37.307952 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927534ab-62a1-4b40-89e7-02916326bef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:37.309360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927534ab-62a1-4b40-89e7-02916326bef6 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-927534ab-62a1-4b40-89e7-02916326bef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:37.321243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:37.322276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:37.323210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:37.323210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:37.323210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:37.323210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:37.323210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:37.323210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:37.323210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:37.323210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:37.323210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 254/515] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:37.323982 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 262/516] 10.222.0.73 () {56 vars in 1139 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:37.324054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd124a-2016-4ff6-93a9-d46d25844088 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:37.324462 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927534ab-62a1-4b40-89e7-02916326bef6 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:37.400057 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:37.425451 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:37.425670 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927534ab-62a1-4b40-89e7-02916326bef6 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:37.428640 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd124a-2016-4ff6-93a9-d46d25844088 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:37.459772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76617da-f532-4b41-a02c-60e96b05d020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:37.460406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76617da-f532-4b41-a02c-60e96b05d020 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:37.460685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76617da-f532-4b41-a02c-60e96b05d020 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:37.460959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76617da-f532-4b41-a02c-60e96b05d020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:37.462960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac839a-773d-4672-b88a-b1c2c0f2746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:37.463585 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac839a-773d-4672-b88a-b1c2c0f2746e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:37.463872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac839a-773d-4672-b88a-b1c2c0f2746e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:37.464148 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac839a-773d-4672-b88a-b1c2c0f2746e None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:37.464897 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac839a-773d-4672-b88a-b1c2c0f2746e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:37.465212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac839a-773d-4672-b88a-b1c2c0f2746e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:37.466669 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac839a-773d-4672-b88a-b1c2c0f2746e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:37.472202 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76617da-f532-4b41-a02c-60e96b05d020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:37.473665 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76617da-f532-4b41-a02c-60e96b05d020 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:37.484348 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 263/517] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:37.485384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac839a-773d-4672-b88a-b1c2c0f2746e None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-d76617da-f532-4b41-a02c-60e96b05d020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:37.488225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:37.489072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:37.490464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:37.490464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:37.490464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:37.490464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:37.490464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 255/518] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:37.490464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76617da-f532-4b41-a02c-60e96b05d020 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:37.593636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac839a-773d-4672-b88a-b1c2c0f2746e None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:37.595746 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76617da-f532-4b41-a02c-60e96b05d020 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:37.620572 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:37.627906 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd922a0d-e403-44d2-9994-56087672b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:37.628517 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd922a0d-e403-44d2-9994-56087672b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:37.628797 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd922a0d-e403-44d2-9994-56087672b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:37.629072 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd922a0d-e403-44d2-9994-56087672b0c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:37.629304 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bac131-b2da-4f9f-bbcc-38170124a812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:37.629918 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bac131-b2da-4f9f-bbcc-38170124a812 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:37.630198 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bac131-b2da-4f9f-bbcc-38170124a812 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:37.630471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bac131-b2da-4f9f-bbcc-38170124a812 None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:37.631246 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bac131-b2da-4f9f-bbcc-38170124a812 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:37.631552 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bac131-b2da-4f9f-bbcc-38170124a812 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:37.632971 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bac131-b2da-4f9f-bbcc-38170124a812 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:37.650644 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 256/519] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:37.651432 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bac131-b2da-4f9f-bbcc-38170124a812 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:37.656810 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:37.696962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd922a0d-e403-44d2-9994-56087672b0c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:37.698443 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd922a0d-e403-44d2-9994-56087672b0c7 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:37.750831 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bac131-b2da-4f9f-bbcc-38170124a812 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:37.785895 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac598ae-8b84-46ed-9420-c9e4b4f3450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:37.786532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac598ae-8b84-46ed-9420-c9e4b4f3450d None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:37.786850 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac598ae-8b84-46ed-9420-c9e4b4f3450d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:37.787134 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac598ae-8b84-46ed-9420-c9e4b4f3450d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:37.787923 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac598ae-8b84-46ed-9420-c9e4b4f3450d None admin] RBAC: Adding query filter params (role.id=af430df1b4ae42f3bc51a56f0cb42e33, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=de6300c387da4594bca473cd708b79f9) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:37.788238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac598ae-8b84-46ed-9420-c9e4b4f3450d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:37.789676 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac598ae-8b84-46ed-9420-c9e4b4f3450d None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:37.795425 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 257/520] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/role_assignments?user.id=de6300c387da4594bca473cd708b79f9&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=af430df1b4ae42f3bc51a56f0cb42e33 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:37.796367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac598ae-8b84-46ed-9420-c9e4b4f3450d None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:37.802666 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 264/521] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:37.803865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd922a0d-e403-44d2-9994-56087672b0c7 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:37.856573 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:37.888073 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:37.915321 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac598ae-8b84-46ed-9420-c9e4b4f3450d None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:37.936353 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd922a0d-e403-44d2-9994-56087672b0c7 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:37.952351 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e5ca-8fb2-46de-8673-b8c223110829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:37.952984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e5ca-8fb2-46de-8673-b8c223110829 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:37.953259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e5ca-8fb2-46de-8673-b8c223110829 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:37.953535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e5ca-8fb2-46de-8673-b8c223110829 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:37.954235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08e5ca-8fb2-46de-8673-b8c223110829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:37.954643 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08e5ca-8fb2-46de-8673-b8c223110829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:37.956077 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08e5ca-8fb2-46de-8673-b8c223110829 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:37.974968 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 258/522] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:37.975949 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e5ca-8fb2-46de-8673-b8c223110829 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:37.977416 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4b57f-1777-40aa-8251-d90bce9e714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:37.978285 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4b57f-1777-40aa-8251-d90bce9e714a None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:37.978616 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4b57f-1777-40aa-8251-d90bce9e714a None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:37.979119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4b57f-1777-40aa-8251-d90bce9e714a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:37.980812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4b57f-1777-40aa-8251-d90bce9e714a None admin] RBAC: Adding query filter params (role.id=af430df1b4ae42f3bc51a56f0cb42e33, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=dd0601985b76490dae3f9d0ce2fe9505) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:37.981126 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4b57f-1777-40aa-8251-d90bce9e714a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:37.982698 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4b57f-1777-40aa-8251-d90bce9e714a None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:37.990396 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 265/523] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/role_assignments?user.id=dd0601985b76490dae3f9d0ce2fe9505&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=af430df1b4ae42f3bc51a56f0cb42e33 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:37.991327 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4b57f-1777-40aa-8251-d90bce9e714a None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:38.103815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e5ca-8fb2-46de-8673-b8c223110829 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:38.127542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:38.128571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4b57f-1777-40aa-8251-d90bce9e714a None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:38.143051 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ef4b3-aa9d-45cd-920c-5cad60190553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:38.144188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ef4b3-aa9d-45cd-920c-5cad60190553 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:38.144567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ef4b3-aa9d-45cd-920c-5cad60190553 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:38.144939 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ef4b3-aa9d-45cd-920c-5cad60190553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:38.157038 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ef4b3-aa9d-45cd-920c-5cad60190553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:38.158975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:38.159922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ef4b3-aa9d-45cd-920c-5cad60190553 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:38.173245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f56ba7-e32e-49f0-9f80-1eb6a18e7e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:38.174426 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56ba7-e32e-49f0-9f80-1eb6a18e7e95 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:38.174918 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56ba7-e32e-49f0-9f80-1eb6a18e7e95 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:38.175342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56ba7-e32e-49f0-9f80-1eb6a18e7e95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-650ef4b3-aa9d-45cd-920c-5cad60190553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:38.177588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:38.179008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:38.179990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:38.179990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:38.179990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:38.179990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:38.185137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 259/524] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:38.186243 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ef4b3-aa9d-45cd-920c-5cad60190553 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:38.187125 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f56ba7-e32e-49f0-9f80-1eb6a18e7e95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:38.188885 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f56ba7-e32e-49f0-9f80-1eb6a18e7e95 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-27f56ba7-e32e-49f0-9f80-1eb6a18e7e95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:38.202091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:38.203179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:38.204034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:38.204034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:38.204034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:38.204034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:38.204034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:38.204034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:38.204034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:38.204034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:38.208159 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 266/525] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:38.214926 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f56ba7-e32e-49f0-9f80-1eb6a18e7e95 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:38.312015 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ef4b3-aa9d-45cd-920c-5cad60190553 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:38.347304 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f56ba7-e32e-49f0-9f80-1eb6a18e7e95 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:38.360155 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66865-94be-453a-8640-4b0f7fb81cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:38.361631 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66865-94be-453a-8640-4b0f7fb81cd2 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:38.361631 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66865-94be-453a-8640-4b0f7fb81cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:38.362166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66865-94be-453a-8640-4b0f7fb81cd2 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:38.363393 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac66865-94be-453a-8640-4b0f7fb81cd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:38.363712 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac66865-94be-453a-8640-4b0f7fb81cd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:38.365670 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac66865-94be-453a-8640-4b0f7fb81cd2 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:38.383307 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 260/526] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:38.388421 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66865-94be-453a-8640-4b0f7fb81cd2 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:38.389986 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48714af2-167c-4371-90b1-eaa6913856e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:38.390643 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714af2-167c-4371-90b1-eaa6913856e8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:38.390930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714af2-167c-4371-90b1-eaa6913856e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:38.391207 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714af2-167c-4371-90b1-eaa6913856e8 None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:38.391967 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48714af2-167c-4371-90b1-eaa6913856e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:38.392311 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48714af2-167c-4371-90b1-eaa6913856e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:38.393751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48714af2-167c-4371-90b1-eaa6913856e8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:38.412234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 267/527] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:38.419510 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48714af2-167c-4371-90b1-eaa6913856e8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:38.420766 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:38.479393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:38.509805 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66865-94be-453a-8640-4b0f7fb81cd2 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:38.540153 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48714af2-167c-4371-90b1-eaa6913856e8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:38.552539 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc3aa7-85e2-4687-b197-ce466d98c99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:38.553596 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc3aa7-85e2-4687-b197-ce466d98c99b None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:38.554106 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc3aa7-85e2-4687-b197-ce466d98c99b None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:38.554633 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc3aa7-85e2-4687-b197-ce466d98c99b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:38.563250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc3aa7-85e2-4687-b197-ce466d98c99b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:38.565638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc3aa7-85e2-4687-b197-ce466d98c99b None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:38.584745 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66637e5a-d843-489a-a33a-b791e381380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:38.584745 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66637e5a-d843-489a-a33a-b791e381380d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:38.584745 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66637e5a-d843-489a-a33a-b791e381380d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:38.584745 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66637e5a-d843-489a-a33a-b791e381380d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:38.585165 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66637e5a-d843-489a-a33a-b791e381380d None admin] RBAC: Adding query filter params (role.id=af430df1b4ae42f3bc51a56f0cb42e33, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=856e3f650ab34f15828f1adb320d03ca) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:38.585165 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66637e5a-d843-489a-a33a-b791e381380d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:38.586094 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66637e5a-d843-489a-a33a-b791e381380d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-3ecc3aa7-85e2-4687-b197-ce466d98c99b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:38.590406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:38.591261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:38.592160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:38.592160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:38.592160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:38.592160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:38.592160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:38.592160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:38.592160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:38.592160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:38.593040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 268/528] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:38 2022] GET /identity/v3/role_assignments?user.id=856e3f650ab34f15828f1adb320d03ca&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=af430df1b4ae42f3bc51a56f0cb42e33 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:38.599306 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 261/529] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:38.600811 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66637e5a-d843-489a-a33a-b791e381380d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:38.715324 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66637e5a-d843-489a-a33a-b791e381380d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:38.727261 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:38.753593 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7561e3d-8aca-489b-acde-53a99ec35fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:38.754236 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7561e3d-8aca-489b-acde-53a99ec35fe9 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:38.754548 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7561e3d-8aca-489b-acde-53a99ec35fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:38.754816 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7561e3d-8aca-489b-acde-53a99ec35fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:38.755598 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7561e3d-8aca-489b-acde-53a99ec35fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:38.755907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7561e3d-8aca-489b-acde-53a99ec35fe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:38.757382 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7561e3d-8aca-489b-acde-53a99ec35fe9 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:38.772123 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 269/530] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:38.778365 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc3aa7-85e2-4687-b197-ce466d98c99b None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:38.874938 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:38.886353 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc3aa7-85e2-4687-b197-ce466d98c99b None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:38.921983 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e58e1e-2082-45f7-9f2d-b881c06c4025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:38.922637 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58e1e-2082-45f7-9f2d-b881c06c4025 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:38.923010 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58e1e-2082-45f7-9f2d-b881c06c4025 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:38.923798 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58e1e-2082-45f7-9f2d-b881c06c4025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:38.924623 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e58e1e-2082-45f7-9f2d-b881c06c4025 None admin] RBAC: Adding query filter params (role.id=af430df1b4ae42f3bc51a56f0cb42e33, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=54abb42639f1401bb6433e2d4642d741) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:38.924936 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e58e1e-2082-45f7-9f2d-b881c06c4025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:38.926390 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e58e1e-2082-45f7-9f2d-b881c06c4025 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:38.932603 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 262/531] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:38 2022] GET /identity/v3/role_assignments?user.id=54abb42639f1401bb6433e2d4642d741&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=af430df1b4ae42f3bc51a56f0cb42e33 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:40.144847 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feebb0-316e-4c54-979d-ef62df184ded None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:40.145368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feebb0-316e-4c54-979d-ef62df184ded None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:40.145368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feebb0-316e-4c54-979d-ef62df184ded None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:40.147043 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 270/532] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:40.152929 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9cf83-14c6-4edf-9dad-ae1776c108ff None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:40.153388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9cf83-14c6-4edf-9dad-ae1776c108ff None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:40.153483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9cf83-14c6-4edf-9dad-ae1776c108ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:40.171656 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-09c9cf83-14c6-4edf-9dad-ae1776c108ff None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:40.172858 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-09c9cf83-14c6-4edf-9dad-ae1776c108ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:40.245388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 263/533] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:40.271086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1feebb0-316e-4c54-979d-ef62df184ded None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:40.382307 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1feebb0-316e-4c54-979d-ef62df184ded None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:40.414975 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369379a-44a5-4c2f-be80-9149f27da8bc None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:40.415250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369379a-44a5-4c2f-be80-9149f27da8bc None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:40.415449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369379a-44a5-4c2f-be80-9149f27da8bc None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:40.417043 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 264/534] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:40.418723 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27d91-608c-4fe5-8e7d-99677e038173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:40.419375 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27d91-608c-4fe5-8e7d-99677e038173 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:40.419661 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27d91-608c-4fe5-8e7d-99677e038173 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:40.419941 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27d91-608c-4fe5-8e7d-99677e038173 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:40.421855 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960ae5-0e7c-412b-86e9-a1cf8e68f779 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:40.422143 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960ae5-0e7c-412b-86e9-a1cf8e68f779 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:40.422421 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960ae5-0e7c-412b-86e9-a1cf8e68f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:40.433098 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe27d91-608c-4fe5-8e7d-99677e038173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-cfe27d91-608c-4fe5-8e7d-99677e038173 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:40.438869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:40.439872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:40.440714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 271/535] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:40.445787 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-b7960ae5-0e7c-412b-86e9-a1cf8e68f779 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:40.445990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27d91-608c-4fe5-8e7d-99677e038173 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:40.447007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-b7960ae5-0e7c-412b-86e9-a1cf8e68f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:40.490918 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:40.538608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 265/536] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:40.565664 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7960ae5-0e7c-412b-86e9-a1cf8e68f779 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:40.577301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:40.582433 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27d91-608c-4fe5-8e7d-99677e038173 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:40.627909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ba9b1-e072-4b43-b330-f2d2fdbb1171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:40.628925 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ba9b1-e072-4b43-b330-f2d2fdbb1171 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:40.629404 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ba9b1-e072-4b43-b330-f2d2fdbb1171 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:40.629924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ba9b1-e072-4b43-b330-f2d2fdbb1171 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:40.631002 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ba9b1-e072-4b43-b330-f2d2fdbb1171 None admin] RBAC: Adding query filter params (name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:40.631514 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ba9b1-e072-4b43-b330-f2d2fdbb1171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:40.633087 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ba9b1-e072-4b43-b330-f2d2fdbb1171 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:40.646977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 272/537] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:40.648973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ba9b1-e072-4b43-b330-f2d2fdbb1171 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:40.691738 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7960ae5-0e7c-412b-86e9-a1cf8e68f779 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:40.735526 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf92bd9-5862-4150-9d2c-3f339008af37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:40.736755 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf92bd9-5862-4150-9d2c-3f339008af37 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:40.737051 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf92bd9-5862-4150-9d2c-3f339008af37 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:40.737706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf92bd9-5862-4150-9d2c-3f339008af37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:40.751559 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf92bd9-5862-4150-9d2c-3f339008af37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:40.752528 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-3bf92bd9-5862-4150-9d2c-3f339008af37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:40.757967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:40.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:40.759820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:40.764342 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 266/538] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:40.765789 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf92bd9-5862-4150-9d2c-3f339008af37 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:40.780073 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ba9b1-e072-4b43-b330-f2d2fdbb1171 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:40.825210 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a8d1c-6f16-4bf0-91e3-a0d23dc2f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:40.826264 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a8d1c-6f16-4bf0-91e3-a0d23dc2f8ff None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:40.826905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a8d1c-6f16-4bf0-91e3-a0d23dc2f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:40.827476 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a8d1c-6f16-4bf0-91e3-a0d23dc2f8ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:40.839758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a8d1c-6f16-4bf0-91e3-a0d23dc2f8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:40.841764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a8d1c-6f16-4bf0-91e3-a0d23dc2f8ff None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:40.849506 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-781a8d1c-6f16-4bf0-91e3-a0d23dc2f8ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:40.861439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:40.862490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:40.863363 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:40.863363 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:40.863363 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:40.863363 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:40.870608 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 273/539] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:40.871889 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a8d1c-6f16-4bf0-91e3-a0d23dc2f8ff None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:40.892136 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf92bd9-5862-4150-9d2c-3f339008af37 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:40.936660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa220f2-28f0-45a4-b06d-15a252e7d43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:40.937406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa220f2-28f0-45a4-b06d-15a252e7d43d None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:40.937697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa220f2-28f0-45a4-b06d-15a252e7d43d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:40.938142 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa220f2-28f0-45a4-b06d-15a252e7d43d None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:40.939803 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa220f2-28f0-45a4-b06d-15a252e7d43d None admin] RBAC: Adding query filter params (name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:40.940387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa220f2-28f0-45a4-b06d-15a252e7d43d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:40.942027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa220f2-28f0-45a4-b06d-15a252e7d43d None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:40.952509 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 267/540] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:40.953873 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d478fd0-65c4-4160-8182-7a8b3f0a08a0 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:40.954254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d478fd0-65c4-4160-8182-7a8b3f0a08a0 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:40.955267 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d478fd0-65c4-4160-8182-7a8b3f0a08a0 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:40.960427 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 268/541] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:40.960427 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d478fd0-65c4-4160-8182-7a8b3f0a08a0 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:40.991653 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a8d1c-6f16-4bf0-91e3-a0d23dc2f8ff None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:41.028450 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3696c10-c76b-4bbc-ac18-334fd5a65034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:41.029409 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3696c10-c76b-4bbc-ac18-334fd5a65034 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.029902 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3696c10-c76b-4bbc-ac18-334fd5a65034 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.030276 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3696c10-c76b-4bbc-ac18-334fd5a65034 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.031013 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3696c10-c76b-4bbc-ac18-334fd5a65034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:41.031325 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3696c10-c76b-4bbc-ac18-334fd5a65034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:41.032751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3696c10-c76b-4bbc-ac18-334fd5a65034 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:41.052011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 274/542] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:41.052011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790aa80-598d-4653-831f-ffa8ae8bae5d None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.052011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790aa80-598d-4653-831f-ffa8ae8bae5d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.052011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790aa80-598d-4653-831f-ffa8ae8bae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.056325 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:41.071080 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-6790aa80-598d-4653-831f-ffa8ae8bae5d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:41.072343 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-6790aa80-598d-4653-831f-ffa8ae8bae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:41.076686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d478fd0-65c4-4160-8182-7a8b3f0a08a0 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:41.107496 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:41.117733 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0579c3-f0c5-4dce-a535-033efcd71995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:41.118387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0579c3-f0c5-4dce-a535-033efcd71995 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.118709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0579c3-f0c5-4dce-a535-033efcd71995 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.118987 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0579c3-f0c5-4dce-a535-033efcd71995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.131204 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0579c3-f0c5-4dce-a535-033efcd71995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:41.133012 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0579c3-f0c5-4dce-a535-033efcd71995 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-8a0579c3-f0c5-4dce-a535-033efcd71995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:41.149071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:41.149965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:41.151542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:41.151542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:41.151542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:41.151542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:41.151542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 269/543] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:41.156060 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0579c3-f0c5-4dce-a535-033efcd71995 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:41.166713 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 275/544] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:41.166713 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790aa80-598d-4653-831f-ffa8ae8bae5d None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:41.261000 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0579c3-f0c5-4dce-a535-033efcd71995 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:41.270816 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790aa80-598d-4653-831f-ffa8ae8bae5d None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:41.295246 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779be5f6-f1cf-46ea-91cf-dcdd7e867122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:41.295914 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779be5f6-f1cf-46ea-91cf-dcdd7e867122 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.296200 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779be5f6-f1cf-46ea-91cf-dcdd7e867122 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.296480 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779be5f6-f1cf-46ea-91cf-dcdd7e867122 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.301266 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:41.305124 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779be5f6-f1cf-46ea-91cf-dcdd7e867122 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:41.306487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c28a3d-77fd-46fc-b601-ccf1a30cf712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:41.306639 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779be5f6-f1cf-46ea-91cf-dcdd7e867122 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:41.307168 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c28a3d-77fd-46fc-b601-ccf1a30cf712 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.307410 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c28a3d-77fd-46fc-b601-ccf1a30cf712 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.307684 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c28a3d-77fd-46fc-b601-ccf1a30cf712 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.308371 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c28a3d-77fd-46fc-b601-ccf1a30cf712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:41.308673 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c28a3d-77fd-46fc-b601-ccf1a30cf712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:41.310017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c28a3d-77fd-46fc-b601-ccf1a30cf712 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-779be5f6-f1cf-46ea-91cf-dcdd7e867122 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:41.319279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:41.320235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:41.321159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:41.321159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:41.321159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:41.321159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:41.321159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:41.321159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:41.321159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:41.321159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:41.321159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:52:41.321159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:41.321159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 270/545] 10.222.0.73 () {56 vars in 1093 bytes} [Wed Jul 27 17:52:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:41.327033 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779be5f6-f1cf-46ea-91cf-dcdd7e867122 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:41.327120 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 276/546] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:41.327120 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19288c0-dc42-49fe-973a-c09e4b2d72ab None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.327120 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19288c0-dc42-49fe-973a-c09e4b2d72ab None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.327120 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19288c0-dc42-49fe-973a-c09e4b2d72ab None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.327120 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 277/547] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:41.327120 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19288c0-dc42-49fe-973a-c09e4b2d72ab None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:41.368706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:41.430178 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779be5f6-f1cf-46ea-91cf-dcdd7e867122 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:41.430380 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19288c0-dc42-49fe-973a-c09e4b2d72ab None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:41.463592 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd1fcf-0e2b-44ce-8786-4c6b7256bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:41.464230 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1fcf-0e2b-44ce-8786-4c6b7256bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.464412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeed37c-258c-4cbf-a131-dbfc3808cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:41.464522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1fcf-0e2b-44ce-8786-4c6b7256bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.464822 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1fcf-0e2b-44ce-8786-4c6b7256bbd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.465033 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeed37c-258c-4cbf-a131-dbfc3808cc30 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.465317 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeed37c-258c-4cbf-a131-dbfc3808cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.465598 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeed37c-258c-4cbf-a131-dbfc3808cc30 None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.466398 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeed37c-258c-4cbf-a131-dbfc3808cc30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:41.466736 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeed37c-258c-4cbf-a131-dbfc3808cc30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:41.468172 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeed37c-258c-4cbf-a131-dbfc3808cc30 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:41.475536 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd1fcf-0e2b-44ce-8786-4c6b7256bbd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-77fd1fcf-0e2b-44ce-8786-4c6b7256bbd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:41.480835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:41.481922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 271/548] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:41.482835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd1fcf-0e2b-44ce-8786-4c6b7256bbd5 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:41.490960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 278/549] 10.222.0.73 () {56 vars in 1133 bytes} [Wed Jul 27 17:52:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:41.490960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6f232-a58a-4a0c-b75c-c972c4c7a62a None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.490960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6f232-a58a-4a0c-b75c-c972c4c7a62a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.490960 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6f232-a58a-4a0c-b75c-c972c4c7a62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.508717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-7bf6f232-a58a-4a0c-b75c-c972c4c7a62a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:41.509937 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-7bf6f232-a58a-4a0c-b75c-c972c4c7a62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:41.560329 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:41.582390 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 279/550] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:41.583264 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6f232-a58a-4a0c-b75c-c972c4c7a62a None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:41.583909 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:41.587650 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd1fcf-0e2b-44ce-8786-4c6b7256bbd5 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:41.624713 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9a6bb-e3a6-474b-87fa-72c5597c0383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:41.625362 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9a6bb-e3a6-474b-87fa-72c5597c0383 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.625646 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9a6bb-e3a6-474b-87fa-72c5597c0383 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.625928 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9a6bb-e3a6-474b-87fa-72c5597c0383 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.634084 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9a6bb-e3a6-474b-87fa-72c5597c0383 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:41.635583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9a6bb-e3a6-474b-87fa-72c5597c0383 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-cfc9a6bb-e3a6-474b-87fa-72c5597c0383 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:41.647538 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:41.648471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:41.649358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:41.649358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:41.649358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:41.649358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:41.649358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:41.649358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:41.649358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:41.649358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:41.649358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 17:52:41.649358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:41.649358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 272/551] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:41.650475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9a6bb-e3a6-474b-87fa-72c5597c0383 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:41.697992 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6f232-a58a-4a0c-b75c-c972c4c7a62a None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:41.731486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e37fb-3df2-4643-a29f-106028c42844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:41.732117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e37fb-3df2-4643-a29f-106028c42844 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.732405 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e37fb-3df2-4643-a29f-106028c42844 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.732685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e37fb-3df2-4643-a29f-106028c42844 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.733403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e37fb-3df2-4643-a29f-106028c42844 None admin] RBAC: Adding query filter params (name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:41.733714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e37fb-3df2-4643-a29f-106028c42844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:41.735124 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e37fb-3df2-4643-a29f-106028c42844 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:41.743668 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 280/552] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:41.744473 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e37fb-3df2-4643-a29f-106028c42844 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:41.749447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9a6bb-e3a6-474b-87fa-72c5597c0383 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:41.786669 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb717-fc70-4d1f-853c-8c44f5120ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:41.787294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb717-fc70-4d1f-853c-8c44f5120ab8 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.787571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb717-fc70-4d1f-853c-8c44f5120ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.787848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb717-fc70-4d1f-853c-8c44f5120ab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.797818 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:41.799319 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cb717-fc70-4d1f-853c-8c44f5120ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:41.800770 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cb717-fc70-4d1f-853c-8c44f5120ab8 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-103cb717-fc70-4d1f-853c-8c44f5120ab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:41.815238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:41.816292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:41.817283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:41.817283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:41.817283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:41.817283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:41.817283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 273/553] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:41.817283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb717-fc70-4d1f-853c-8c44f5120ab8 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:41.832802 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:41.860457 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e37fb-3df2-4643-a29f-106028c42844 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:41.894364 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebc84f-d815-4331-bd9f-4663f3c3c7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:41.895054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebc84f-d815-4331-bd9f-4663f3c3c7c8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.895341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebc84f-d815-4331-bd9f-4663f3c3c7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.895620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebc84f-d815-4331-bd9f-4663f3c3c7c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.906125 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebc84f-d815-4331-bd9f-4663f3c3c7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-31ebc84f-d815-4331-bd9f-4663f3c3c7c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:41.912105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:41.913206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 281/554] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:41.919095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebc84f-d815-4331-bd9f-4663f3c3c7c8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:41.919828 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb717-fc70-4d1f-853c-8c44f5120ab8 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:41.952528 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab812b0-03df-4f31-ab55-c22e0da06bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:41.953152 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab812b0-03df-4f31-ab55-c22e0da06bd6 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:41.953438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab812b0-03df-4f31-ab55-c22e0da06bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:41.953908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab812b0-03df-4f31-ab55-c22e0da06bd6 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:41.954492 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab812b0-03df-4f31-ab55-c22e0da06bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:41.955532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab812b0-03df-4f31-ab55-c22e0da06bd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:41.957067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab812b0-03df-4f31-ab55-c22e0da06bd6 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:41.974611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 274/555] 10.222.0.73 () {56 vars in 1137 bytes} [Wed Jul 27 17:52:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:41.975457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab812b0-03df-4f31-ab55-c22e0da06bd6 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.023793 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebc84f-d815-4331-bd9f-4663f3c3c7c8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:42.045030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:42.062639 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b03f1-add8-4de4-915a-07f471bcc468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.063280 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b03f1-add8-4de4-915a-07f471bcc468 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.063561 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b03f1-add8-4de4-915a-07f471bcc468 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.063835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b03f1-add8-4de4-915a-07f471bcc468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.075293 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b03f1-add8-4de4-915a-07f471bcc468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.076780 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b03f1-add8-4de4-915a-07f471bcc468 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.076888 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab812b0-03df-4f31-ab55-c22e0da06bd6 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-296b03f1-add8-4de4-915a-07f471bcc468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:42.091973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:42.093104 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:42.093993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:42.093993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:42.093993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:42.093993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:42.093993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 282/556] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:42.093993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b03f1-add8-4de4-915a-07f471bcc468 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.116713 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6febb3-45ca-4f61-a4b5-fccffadac4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.117321 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6febb3-45ca-4f61-a4b5-fccffadac4a6 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.117599 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6febb3-45ca-4f61-a4b5-fccffadac4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.117880 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6febb3-45ca-4f61-a4b5-fccffadac4a6 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.118584 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6febb3-45ca-4f61-a4b5-fccffadac4a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:42.118889 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6febb3-45ca-4f61-a4b5-fccffadac4a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.120252 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6febb3-45ca-4f61-a4b5-fccffadac4a6 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.132217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 275/557] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:42.133008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6febb3-45ca-4f61-a4b5-fccffadac4a6 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.202972 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b03f1-add8-4de4-915a-07f471bcc468 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.234270 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6febb3-45ca-4f61-a4b5-fccffadac4a6 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.237821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725acf6-a1ba-40e1-a7d5-ebf6a40b4e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.238374 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725acf6-a1ba-40e1-a7d5-ebf6a40b4e86 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.238688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725acf6-a1ba-40e1-a7d5-ebf6a40b4e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.239020 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725acf6-a1ba-40e1-a7d5-ebf6a40b4e86 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.239735 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725acf6-a1ba-40e1-a7d5-ebf6a40b4e86 None admin] RBAC: Adding query filter params (name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:42.240064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725acf6-a1ba-40e1-a7d5-ebf6a40b4e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.241434 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725acf6-a1ba-40e1-a7d5-ebf6a40b4e86 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.249690 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 283/558] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:42.250698 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725acf6-a1ba-40e1-a7d5-ebf6a40b4e86 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.267097 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:42.270359 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:42.274326 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1b99-9513-4c0b-ad64-cd623a77fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.275072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1b99-9513-4c0b-ad64-cd623a77fcbb None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.275350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1b99-9513-4c0b-ad64-cd623a77fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.275880 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1b99-9513-4c0b-ad64-cd623a77fcbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.287323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e1b99-9513-4c0b-ad64-cd623a77fcbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.288763 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e1b99-9513-4c0b-ad64-cd623a77fcbb None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-3e2e1b99-9513-4c0b-ad64-cd623a77fcbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:42.303182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:42.304709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:42.305791 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:42.305791 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:42.305791 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:42.305791 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:42.308940 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 276/559] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:42.309774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1b99-9513-4c0b-ad64-cd623a77fcbb None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.353493 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725acf6-a1ba-40e1-a7d5-ebf6a40b4e86 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.387141 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31728ba0-da62-49ce-a47c-768d1923461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.387764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728ba0-da62-49ce-a47c-768d1923461c None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.388051 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728ba0-da62-49ce-a47c-768d1923461c None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.388329 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728ba0-da62-49ce-a47c-768d1923461c None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.389021 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31728ba0-da62-49ce-a47c-768d1923461c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:42.389332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31728ba0-da62-49ce-a47c-768d1923461c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.390756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31728ba0-da62-49ce-a47c-768d1923461c None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.403198 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 284/560] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:42.404005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31728ba0-da62-49ce-a47c-768d1923461c None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.413683 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1b99-9513-4c0b-ad64-cd623a77fcbb None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.447524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f187dd9-d586-4fd1-a152-d2e3838359e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.448157 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187dd9-d586-4fd1-a152-d2e3838359e2 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.448436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187dd9-d586-4fd1-a152-d2e3838359e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.448710 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187dd9-d586-4fd1-a152-d2e3838359e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.455283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f187dd9-d586-4fd1-a152-d2e3838359e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.456714 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f187dd9-d586-4fd1-a152-d2e3838359e2 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-6f187dd9-d586-4fd1-a152-d2e3838359e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:42.467790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:42.468881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:42.469941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:42.469941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:42.469941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:42.469941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:42.469941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:42.469941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:42.469941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:42.469941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:42.469941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 277/561] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:42.469941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f187dd9-d586-4fd1-a152-d2e3838359e2 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.484578 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:42.508307 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31728ba0-da62-49ce-a47c-768d1923461c None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.513388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:42.543488 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce355-e609-44d1-b7c3-e338011774bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.544132 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce355-e609-44d1-b7c3-e338011774bb None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.544423 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce355-e609-44d1-b7c3-e338011774bb None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.544700 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce355-e609-44d1-b7c3-e338011774bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.555449 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ce355-e609-44d1-b7c3-e338011774bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.556997 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ce355-e609-44d1-b7c3-e338011774bb None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.571765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f187dd9-d586-4fd1-a152-d2e3838359e2 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-e42ce355-e609-44d1-b7c3-e338011774bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:42.571928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:42.572999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:42.574014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:42.574014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:42.574014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:42.574014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:42.574014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 285/562] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:42.574300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce355-e609-44d1-b7c3-e338011774bb None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.610621 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3259d8d-66a6-4817-831e-2bbb624eee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.611844 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259d8d-66a6-4817-831e-2bbb624eee47 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.612239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259d8d-66a6-4817-831e-2bbb624eee47 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.612391 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259d8d-66a6-4817-831e-2bbb624eee47 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.613095 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3259d8d-66a6-4817-831e-2bbb624eee47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:42.613386 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3259d8d-66a6-4817-831e-2bbb624eee47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.615319 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3259d8d-66a6-4817-831e-2bbb624eee47 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.630894 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 278/563] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:42.631740 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3259d8d-66a6-4817-831e-2bbb624eee47 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.676638 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce355-e609-44d1-b7c3-e338011774bb None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.702293 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:42.711092 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8b51-1f1b-4fca-a278-e5ed0dc167f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.711744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8b51-1f1b-4fca-a278-e5ed0dc167f1 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.712028 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8b51-1f1b-4fca-a278-e5ed0dc167f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.712312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8b51-1f1b-4fca-a278-e5ed0dc167f1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.719874 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d8b51-1f1b-4fca-a278-e5ed0dc167f1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.721595 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d8b51-1f1b-4fca-a278-e5ed0dc167f1 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.730316 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3259d8d-66a6-4817-831e-2bbb624eee47 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.731859 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-863d8b51-1f1b-4fca-a278-e5ed0dc167f1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:42.732855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:42.733970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 286/564] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:42.735044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8b51-1f1b-4fca-a278-e5ed0dc167f1 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.770455 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028048b4-bb63-4b1c-8e49-fdc416cf093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.771119 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028048b4-bb63-4b1c-8e49-fdc416cf093b None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.771402 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028048b4-bb63-4b1c-8e49-fdc416cf093b None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.771680 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028048b4-bb63-4b1c-8e49-fdc416cf093b None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.772435 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028048b4-bb63-4b1c-8e49-fdc416cf093b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:42.772744 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028048b4-bb63-4b1c-8e49-fdc416cf093b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.774184 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028048b4-bb63-4b1c-8e49-fdc416cf093b None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.787248 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 279/565] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:42.788231 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028048b4-bb63-4b1c-8e49-fdc416cf093b None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.842025 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8b51-1f1b-4fca-a278-e5ed0dc167f1 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.878534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eda6d0-7f32-4b28-84b3-1e26d67c55de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.879118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda6d0-7f32-4b28-84b3-1e26d67c55de None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.879406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda6d0-7f32-4b28-84b3-1e26d67c55de None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.879686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda6d0-7f32-4b28-84b3-1e26d67c55de None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.880392 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eda6d0-7f32-4b28-84b3-1e26d67c55de None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:42.880702 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eda6d0-7f32-4b28-84b3-1e26d67c55de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.882080 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eda6d0-7f32-4b28-84b3-1e26d67c55de None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.891277 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028048b4-bb63-4b1c-8e49-fdc416cf093b None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:42.894427 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 287/566] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:42.895270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eda6d0-7f32-4b28-84b3-1e26d67c55de None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.926240 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822d3f1-f423-491c-bcda-171caef8cd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:42.926910 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d3f1-f423-491c-bcda-171caef8cd0e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:42.927195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d3f1-f423-491c-bcda-171caef8cd0e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:42.927475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d3f1-f423-491c-bcda-171caef8cd0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:42.933972 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822d3f1-f423-491c-bcda-171caef8cd0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:42.935454 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822d3f1-f423-491c-bcda-171caef8cd0e None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:42.947074 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-a822d3f1-f423-491c-bcda-171caef8cd0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:42.947226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:42.948190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:42.949082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:42.949082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:42.949082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:42.949082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:42.949082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:42.949082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:42.949082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:42.949082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:42.949082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 280/567] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:42.949082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822d3f1-f423-491c-bcda-171caef8cd0e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:42.975684 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:43.003080 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eda6d0-7f32-4b28-84b3-1e26d67c55de None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:43.037138 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e9252-d35c-41e8-b9a4-5cbd47572f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:43.037764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e9252-d35c-41e8-b9a4-5cbd47572f3a None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:43.038074 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e9252-d35c-41e8-b9a4-5cbd47572f3a None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:43.038358 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e9252-d35c-41e8-b9a4-5cbd47572f3a None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:43.039191 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e9252-d35c-41e8-b9a4-5cbd47572f3a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:43.039507 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e9252-d35c-41e8-b9a4-5cbd47572f3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:43.040965 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e9252-d35c-41e8-b9a4-5cbd47572f3a None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:43.054333 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822d3f1-f423-491c-bcda-171caef8cd0e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:43.059123 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 288/568] 10.222.0.73 () {56 vars in 1137 bytes} [Wed Jul 27 17:52:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:43.059805 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e9252-d35c-41e8-b9a4-5cbd47572f3a None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:43.091539 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956359e-0154-4d37-acad-77dd287e9d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:43.092205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956359e-0154-4d37-acad-77dd287e9d0d None admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:43.092486 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956359e-0154-4d37-acad-77dd287e9d0d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:43.092770 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956359e-0154-4d37-acad-77dd287e9d0d None admin] PATH_INFO: `/v3/projects/bcf65bac3a154c95b119204e594db593/users/de6300c387da4594bca473cd708b79f9/roles/af430df1b4ae42f3bc51a56f0cb42e33` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:43.107034 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956359e-0154-4d37-acad-77dd287e9d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf65bac3a154c95b119204e594db593, user_id=de6300c387da4594bca473cd708b79f9, role_id=af430df1b4ae42f3bc51a56f0cb42e33)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:43.108485 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956359e-0154-4d37-acad-77dd287e9d0d None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:43.120721 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 281/569] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:52:42 2022] PUT /identity/v3/projects/bcf65bac3a154c95b119204e594db593/users/de6300c387da4594bca473cd708b79f9/roles/af430df1b4ae42f3bc51a56f0cb42e33 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:43.121666 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956359e-0154-4d37-acad-77dd287e9d0d None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:43.167346 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e9252-d35c-41e8-b9a4-5cbd47572f3a None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:43.177773 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:43.204022 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:43.218489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bc035-3fd4-48ea-87eb-97d7bd401fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:43.219203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc035-3fd4-48ea-87eb-97d7bd401fa3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:43.219481 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc035-3fd4-48ea-87eb-97d7bd401fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:43.219759 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc035-3fd4-48ea-87eb-97d7bd401fa3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:43.228113 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bc035-3fd4-48ea-87eb-97d7bd401fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:43.229571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bc035-3fd4-48ea-87eb-97d7bd401fa3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-a41bc035-3fd4-48ea-87eb-97d7bd401fa3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:43.243496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:43.245254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 289/570] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:43.246232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bc035-3fd4-48ea-87eb-97d7bd401fa3 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:43.256773 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956359e-0154-4d37-acad-77dd287e9d0d None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:43.301195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e39abf-79c9-437f-b0f1-3a1d89db5032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:43.301835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e39abf-79c9-437f-b0f1-3a1d89db5032 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:43.302116 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e39abf-79c9-437f-b0f1-3a1d89db5032 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:43.302399 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e39abf-79c9-437f-b0f1-3a1d89db5032 None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:43.303199 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e39abf-79c9-437f-b0f1-3a1d89db5032 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:43.303520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e39abf-79c9-437f-b0f1-3a1d89db5032 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:43.304973 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e39abf-79c9-437f-b0f1-3a1d89db5032 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:43.321001 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 282/571] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:43.321879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e39abf-79c9-437f-b0f1-3a1d89db5032 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:43.373403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bc035-3fd4-48ea-87eb-97d7bd401fa3 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:43.418406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7d17d-7b24-4c1b-8b5e-7e1da9d68ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:43.418983 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7d17d-7b24-4c1b-8b5e-7e1da9d68ddf None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:43.419513 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7d17d-7b24-4c1b-8b5e-7e1da9d68ddf None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:43.419791 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7d17d-7b24-4c1b-8b5e-7e1da9d68ddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:43.429350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e39abf-79c9-437f-b0f1-3a1d89db5032 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:43.435029 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7d17d-7b24-4c1b-8b5e-7e1da9d68ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:43.436984 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7d17d-7b24-4c1b-8b5e-7e1da9d68ddf None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-1ba7d17d-7b24-4c1b-8b5e-7e1da9d68ddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:43.452366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:43.453300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:43.454219 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:43.454219 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:43.454219 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:43.454219 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:43.454219 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 290/572] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:43.454528 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7d17d-7b24-4c1b-8b5e-7e1da9d68ddf None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:43.467713 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:43.473407 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86924e0-6334-4481-a06c-643749362446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:43.474039 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86924e0-6334-4481-a06c-643749362446 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:43.474324 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86924e0-6334-4481-a06c-643749362446 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:43.474701 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86924e0-6334-4481-a06c-643749362446 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:43.475502 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86924e0-6334-4481-a06c-643749362446 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:43.476058 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86924e0-6334-4481-a06c-643749362446 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:43.476768 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:43.477232 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86924e0-6334-4481-a06c-643749362446 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:43.500079 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 283/573] 10.222.0.73 () {56 vars in 1139 bytes} [Wed Jul 27 17:52:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:43.500079 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86924e0-6334-4481-a06c-643749362446 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:43.578259 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7d17d-7b24-4c1b-8b5e-7e1da9d68ddf None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:43.601993 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86924e0-6334-4481-a06c-643749362446 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:43.616204 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fc582-f37b-4606-acb6-ffe66dbb29f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:43.617011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fc582-f37b-4606-acb6-ffe66dbb29f2 None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:43.617331 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fc582-f37b-4606-acb6-ffe66dbb29f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:43.617588 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fc582-f37b-4606-acb6-ffe66dbb29f2 None admin] PATH_INFO: `/v3/projects/bcf65bac3a154c95b119204e594db593/users/dd0601985b76490dae3f9d0ce2fe9505/roles/af430df1b4ae42f3bc51a56f0cb42e33` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:43.638537 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fc582-f37b-4606-acb6-ffe66dbb29f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf65bac3a154c95b119204e594db593, user_id=dd0601985b76490dae3f9d0ce2fe9505, role_id=af430df1b4ae42f3bc51a56f0cb42e33)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:43.638537 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fc582-f37b-4606-acb6-ffe66dbb29f2 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:43.645416 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36f192-730f-4deb-a936-98c885e6e020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:43.646050 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f192-730f-4deb-a936-98c885e6e020 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:43.646353 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f192-730f-4deb-a936-98c885e6e020 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:43.646739 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f192-730f-4deb-a936-98c885e6e020 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:43.647336 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36f192-730f-4deb-a936-98c885e6e020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:43.647820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36f192-730f-4deb-a936-98c885e6e020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:43.649070 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36f192-730f-4deb-a936-98c885e6e020 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:43.662792 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 291/574] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:52:43 2022] PUT /identity/v3/projects/bcf65bac3a154c95b119204e594db593/users/dd0601985b76490dae3f9d0ce2fe9505/roles/af430df1b4ae42f3bc51a56f0cb42e33 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:43.667386 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 284/575] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:43.667483 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fc582-f37b-4606-acb6-ffe66dbb29f2 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:43.669451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36f192-730f-4deb-a936-98c885e6e020 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:43.746883 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:43.749042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:43.790470 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fc582-f37b-4606-acb6-ffe66dbb29f2 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:43.826058 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36f192-730f-4deb-a936-98c885e6e020 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:43.834196 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e8340-7dd0-44ff-bde8-c6d8135b4483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:43.835237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8340-7dd0-44ff-bde8-c6d8135b4483 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:43.835750 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8340-7dd0-44ff-bde8-c6d8135b4483 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:43.836247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8340-7dd0-44ff-bde8-c6d8135b4483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:43.848366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e8340-7dd0-44ff-bde8-c6d8135b4483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:43.850552 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e8340-7dd0-44ff-bde8-c6d8135b4483 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-932e8340-7dd0-44ff-bde8-c6d8135b4483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:43.870361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:43.871569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:43.873122 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:43.873122 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:43.873122 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:43.873122 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:43.873405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549e8f5-3800-47db-8c9b-3bd8fe146d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:43.873405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549e8f5-3800-47db-8c9b-3bd8fe146d95 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:43.873405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549e8f5-3800-47db-8c9b-3bd8fe146d95 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:43.873405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549e8f5-3800-47db-8c9b-3bd8fe146d95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:43.873742 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 292/576] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:43.878275 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e8340-7dd0-44ff-bde8-c6d8135b4483 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:43.883154 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549e8f5-3800-47db-8c9b-3bd8fe146d95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:43.884619 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549e8f5-3800-47db-8c9b-3bd8fe146d95 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-8549e8f5-3800-47db-8c9b-3bd8fe146d95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:43.899294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:43.900433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:43.902063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:43.902063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:43.902063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:43.902063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:43.902063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:43.902063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:43.902063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:43.902063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:43.902063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 285/577] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:43.909398 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549e8f5-3800-47db-8c9b-3bd8fe146d95 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:44.007560 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e8340-7dd0-44ff-bde8-c6d8135b4483 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:44.032025 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:44.047775 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f8a47-5474-48d0-a20d-c66a248c39b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:44.048933 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f8a47-5474-48d0-a20d-c66a248c39b9 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:44.049219 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f8a47-5474-48d0-a20d-c66a248c39b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:44.049540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f8a47-5474-48d0-a20d-c66a248c39b9 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:44.050353 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f8a47-5474-48d0-a20d-c66a248c39b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:44.050716 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f8a47-5474-48d0-a20d-c66a248c39b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:44.052121 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f8a47-5474-48d0-a20d-c66a248c39b9 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:44.056326 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549e8f5-3800-47db-8c9b-3bd8fe146d95 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:44.070130 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:44.070971 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 293/578] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:44.078665 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f8a47-5474-48d0-a20d-c66a248c39b9 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:44.099025 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6568-574d-4650-8f3d-5267419261e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:44.100664 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6568-574d-4650-8f3d-5267419261e9 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:44.100945 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6568-574d-4650-8f3d-5267419261e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:44.101222 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6568-574d-4650-8f3d-5267419261e9 None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:44.101980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e6568-574d-4650-8f3d-5267419261e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:44.102290 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e6568-574d-4650-8f3d-5267419261e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:44.103771 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e6568-574d-4650-8f3d-5267419261e9 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:44.118453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 286/579] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:44.124006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6568-574d-4650-8f3d-5267419261e9 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:44.188966 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f8a47-5474-48d0-a20d-c66a248c39b9 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:44.231734 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec857047-6b64-41c4-ae0f-18cf340e35e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:44.232397 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6568-574d-4650-8f3d-5267419261e9 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:44.233186 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec857047-6b64-41c4-ae0f-18cf340e35e8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:44.233874 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec857047-6b64-41c4-ae0f-18cf340e35e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:44.234310 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec857047-6b64-41c4-ae0f-18cf340e35e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:44.244037 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec857047-6b64-41c4-ae0f-18cf340e35e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:44.246379 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec857047-6b64-41c4-ae0f-18cf340e35e8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-ec857047-6b64-41c4-ae0f-18cf340e35e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:44.263086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:44.264240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:44.265339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:44.265339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:44.265339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:44.265339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:44.265339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:44.265339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:44.265339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:44.265339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:44.267875 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 294/580] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:44.273530 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec857047-6b64-41c4-ae0f-18cf340e35e8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:44.278307 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c616773-5cff-4556-b1da-3487ee666248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:44.279025 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616773-5cff-4556-b1da-3487ee666248 None admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:44.279224 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616773-5cff-4556-b1da-3487ee666248 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:44.279469 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616773-5cff-4556-b1da-3487ee666248 None admin] PATH_INFO: `/v3/projects/bcf65bac3a154c95b119204e594db593/users/856e3f650ab34f15828f1adb320d03ca/roles/af430df1b4ae42f3bc51a56f0cb42e33` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:44.299893 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c616773-5cff-4556-b1da-3487ee666248 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf65bac3a154c95b119204e594db593, user_id=856e3f650ab34f15828f1adb320d03ca, role_id=af430df1b4ae42f3bc51a56f0cb42e33)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:44.301682 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c616773-5cff-4556-b1da-3487ee666248 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:44.326468 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 287/581] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:52:44 2022] PUT /identity/v3/projects/bcf65bac3a154c95b119204e594db593/users/856e3f650ab34f15828f1adb320d03ca/roles/af430df1b4ae42f3bc51a56f0cb42e33 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:44.329747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:44.405637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec857047-6b64-41c4-ae0f-18cf340e35e8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:44.448783 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eb845-38b3-4875-9482-a7fa6eed7a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:44.449418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eb845-38b3-4875-9482-a7fa6eed7a09 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:44.449701 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eb845-38b3-4875-9482-a7fa6eed7a09 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:44.449978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eb845-38b3-4875-9482-a7fa6eed7a09 None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:44.450778 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eb845-38b3-4875-9482-a7fa6eed7a09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:44.451091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eb845-38b3-4875-9482-a7fa6eed7a09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:44.456327 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eb845-38b3-4875-9482-a7fa6eed7a09 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:44.471196 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 295/582] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:44.473303 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c616773-5cff-4556-b1da-3487ee666248 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:44.512766 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:44.622612 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c616773-5cff-4556-b1da-3487ee666248 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:44.668037 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab25080-fdad-4d0d-9c74-e62cb9ae37d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:44.668734 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab25080-fdad-4d0d-9c74-e62cb9ae37d4 None admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:44.669024 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab25080-fdad-4d0d-9c74-e62cb9ae37d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:44.669303 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab25080-fdad-4d0d-9c74-e62cb9ae37d4 None admin] PATH_INFO: `/v3/projects/bcf65bac3a154c95b119204e594db593/users/54abb42639f1401bb6433e2d4642d741/roles/af430df1b4ae42f3bc51a56f0cb42e33` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:44.691686 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab25080-fdad-4d0d-9c74-e62cb9ae37d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf65bac3a154c95b119204e594db593, user_id=54abb42639f1401bb6433e2d4642d741, role_id=af430df1b4ae42f3bc51a56f0cb42e33)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:44.693332 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab25080-fdad-4d0d-9c74-e62cb9ae37d4 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:44.712145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 288/583] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:52:44 2022] PUT /identity/v3/projects/bcf65bac3a154c95b119204e594db593/users/54abb42639f1401bb6433e2d4642d741/roles/af430df1b4ae42f3bc51a56f0cb42e33 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:45.563040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abbdbe-6dc9-4e37-9460-26e91deb846e None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:45.563567 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abbdbe-6dc9-4e37-9460-26e91deb846e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:45.563567 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abbdbe-6dc9-4e37-9460-26e91deb846e None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:45.565983 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 296/584] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:45.575580 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87028a1-aac7-40b3-b9cc-34583240ea16 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:45.576117 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87028a1-aac7-40b3-b9cc-34583240ea16 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:45.576117 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87028a1-aac7-40b3-b9cc-34583240ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:45.594944 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-a87028a1-aac7-40b3-b9cc-34583240ea16 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:45.596204 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-a87028a1-aac7-40b3-b9cc-34583240ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:45.661876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:45.666929 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 289/585] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:45.693937 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abbdbe-6dc9-4e37-9460-26e91deb846e None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:45.801281 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:45.806232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abbdbe-6dc9-4e37-9460-26e91deb846e None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:45.842181 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b75135-3976-4a89-9b2f-e050951fbd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:45.842961 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b75135-3976-4a89-9b2f-e050951fbd6c None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:45.843325 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b75135-3976-4a89-9b2f-e050951fbd6c None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:45.843674 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b75135-3976-4a89-9b2f-e050951fbd6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:45.854953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b75135-3976-4a89-9b2f-e050951fbd6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-d6b75135-3976-4a89-9b2f-e050951fbd6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:45.860531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:45.861866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:45.863119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:45.866529 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 297/586] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:45.870053 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87028a1-aac7-40b3-b9cc-34583240ea16 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:45.980563 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87028a1-aac7-40b3-b9cc-34583240ea16 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:46.019637 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69a4b7-a0eb-45a2-ab8f-668506d13f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:46.020382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a4b7-a0eb-45a2-ab8f-668506d13f94 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:46.020740 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a4b7-a0eb-45a2-ab8f-668506d13f94 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:46.021088 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a4b7-a0eb-45a2-ab8f-668506d13f94 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:46.021906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69a4b7-a0eb-45a2-ab8f-668506d13f94 None admin] RBAC: Adding query filter params (name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:46.022287 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69a4b7-a0eb-45a2-ab8f-668506d13f94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:46.023782 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69a4b7-a0eb-45a2-ab8f-668506d13f94 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:46.033625 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 290/587] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:46.039107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b75135-3976-4a89-9b2f-e050951fbd6c None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:46.117237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ce94c-a4d6-4645-9a92-f9ad6d5d5db7 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:46.117544 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ce94c-a4d6-4645-9a92-f9ad6d5d5db7 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:46.117887 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ce94c-a4d6-4645-9a92-f9ad6d5d5db7 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:46.119617 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 291/588] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:46.124425 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8413-1b7d-489d-b5f5-3ff0de1891e6 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:46.124823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8413-1b7d-489d-b5f5-3ff0de1891e6 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:46.125222 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8413-1b7d-489d-b5f5-3ff0de1891e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:46.151213 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-8adc8413-1b7d-489d-b5f5-3ff0de1891e6 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:46.151596 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b75135-3976-4a89-9b2f-e050951fbd6c None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:46.152650 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-8adc8413-1b7d-489d-b5f5-3ff0de1891e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:46.188647 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c362614-f246-4414-9500-60259a4c5d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:46.190469 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362614-f246-4414-9500-60259a4c5d00 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:46.191230 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362614-f246-4414-9500-60259a4c5d00 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:46.191658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362614-f246-4414-9500-60259a4c5d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:46.204694 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c362614-f246-4414-9500-60259a4c5d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:46.207386 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c362614-f246-4414-9500-60259a4c5d00 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-4c362614-f246-4414-9500-60259a4c5d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:46.225649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:46.226800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:46.227915 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:46.227915 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:46.227915 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:46.227915 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:46.229719 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 298/589] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:46.231782 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:46.235330 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c362614-f246-4414-9500-60259a4c5d00 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:46.245960 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 292/590] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:46.252606 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:46.270581 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc8413-1b7d-489d-b5f5-3ff0de1891e6 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:46.354124 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c362614-f246-4414-9500-60259a4c5d00 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:46.391869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300030bd-523d-4566-bbf6-f37f5b87eb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:46.393489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300030bd-523d-4566-bbf6-f37f5b87eb0f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:46.394075 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300030bd-523d-4566-bbf6-f37f5b87eb0f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:46.394476 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300030bd-523d-4566-bbf6-f37f5b87eb0f None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:46.394965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc8413-1b7d-489d-b5f5-3ff0de1891e6 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:46.395405 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300030bd-523d-4566-bbf6-f37f5b87eb0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:46.395811 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300030bd-523d-4566-bbf6-f37f5b87eb0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:46.397286 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300030bd-523d-4566-bbf6-f37f5b87eb0f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:46.415064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 299/591] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:46.416206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300030bd-523d-4566-bbf6-f37f5b87eb0f None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:46.443579 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81168674-bf13-4ae1-859c-1f7b3057e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:46.444425 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81168674-bf13-4ae1-859c-1f7b3057e0dc None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:46.444828 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81168674-bf13-4ae1-859c-1f7b3057e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:46.445289 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81168674-bf13-4ae1-859c-1f7b3057e0dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:46.460663 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81168674-bf13-4ae1-859c-1f7b3057e0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-81168674-bf13-4ae1-859c-1f7b3057e0dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:46.469510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:46.470829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:46.471906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:46.474012 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 293/592] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:46.479355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81168674-bf13-4ae1-859c-1f7b3057e0dc None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:46.514220 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:46.548348 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:46.551151 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300030bd-523d-4566-bbf6-f37f5b87eb0f None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:46.601573 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf957aeb-8dc1-4374-a479-0e9a2f137579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:46.603624 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf957aeb-8dc1-4374-a479-0e9a2f137579 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:46.604082 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf957aeb-8dc1-4374-a479-0e9a2f137579 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:46.604779 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf957aeb-8dc1-4374-a479-0e9a2f137579 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:46.606549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81168674-bf13-4ae1-859c-1f7b3057e0dc None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:46.616011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf957aeb-8dc1-4374-a479-0e9a2f137579 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:46.618280 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf957aeb-8dc1-4374-a479-0e9a2f137579 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-cf957aeb-8dc1-4374-a479-0e9a2f137579 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:46.635798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:46.637017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:46.638193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:46.638193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:46.638193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:46.638193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:46.638193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:46.638193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:46.638193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:46.638193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:46.638193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:52:46.638193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:46.641170 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 300/593] 10.222.0.73 () {56 vars in 1093 bytes} [Wed Jul 27 17:52:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:46.647031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf957aeb-8dc1-4374-a479-0e9a2f137579 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:46.653536 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4894387-fd69-4977-8584-9dadc304a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:46.654168 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894387-fd69-4977-8584-9dadc304a1fe None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:46.654453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894387-fd69-4977-8584-9dadc304a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:46.654778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894387-fd69-4977-8584-9dadc304a1fe None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:46.655571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894387-fd69-4977-8584-9dadc304a1fe None admin] RBAC: Adding query filter params (name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:46.655886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894387-fd69-4977-8584-9dadc304a1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:46.657546 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894387-fd69-4977-8584-9dadc304a1fe None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:46.671914 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 294/594] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:46.672840 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4894387-fd69-4977-8584-9dadc304a1fe None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:46.775420 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf957aeb-8dc1-4374-a479-0e9a2f137579 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:46.813137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4894387-fd69-4977-8584-9dadc304a1fe None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:46.818015 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:46.825601 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf833-72f6-407d-b845-41a6eb063d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:46.826907 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf833-72f6-407d-b845-41a6eb063d4a None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:46.827628 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf833-72f6-407d-b845-41a6eb063d4a None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:46.828059 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf833-72f6-407d-b845-41a6eb063d4a None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:46.829264 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdf833-72f6-407d-b845-41a6eb063d4a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:46.829780 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdf833-72f6-407d-b845-41a6eb063d4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:46.830815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:46.833521 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdf833-72f6-407d-b845-41a6eb063d4a None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:46.856549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ff4be-a979-4c9d-9151-c50fc6ce9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:46.857368 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ff4be-a979-4c9d-9151-c50fc6ce9e86 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:46.857756 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ff4be-a979-4c9d-9151-c50fc6ce9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:46.858137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ff4be-a979-4c9d-9151-c50fc6ce9e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:46.859452 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 301/595] 10.222.0.73 () {56 vars in 1133 bytes} [Wed Jul 27 17:52:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:46.865573 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf833-72f6-407d-b845-41a6eb063d4a None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:46.876490 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ff4be-a979-4c9d-9151-c50fc6ce9e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:46.878893 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ff4be-a979-4c9d-9151-c50fc6ce9e86 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-604ff4be-a979-4c9d-9151-c50fc6ce9e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:46.895447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:46.896436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:46.897391 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:46.897391 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:46.897391 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:46.897391 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:46.897391 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 295/596] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:46.898290 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e9288-f158-435c-bd20-66d2c4fe784d None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:46.898290 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e9288-f158-435c-bd20-66d2c4fe784d None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:46.898427 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e9288-f158-435c-bd20-66d2c4fe784d None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:46.899900 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 296/597] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:46.903424 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e9288-f158-435c-bd20-66d2c4fe784d None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:46.986313 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf833-72f6-407d-b845-41a6eb063d4a None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:47.013869 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e9288-f158-435c-bd20-66d2c4fe784d None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:47.028457 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6c362-d1d3-4036-b74d-e250486efd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:47.029204 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6c362-d1d3-4036-b74d-e250486efd0d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.029494 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6c362-d1d3-4036-b74d-e250486efd0d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.029770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6c362-d1d3-4036-b74d-e250486efd0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.053958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724d068-fc7a-4e6c-8fa1-18efc615aa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:47.054720 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724d068-fc7a-4e6c-8fa1-18efc615aa42 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.055065 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724d068-fc7a-4e6c-8fa1-18efc615aa42 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.055423 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724d068-fc7a-4e6c-8fa1-18efc615aa42 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.056203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724d068-fc7a-4e6c-8fa1-18efc615aa42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:47.056582 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724d068-fc7a-4e6c-8fa1-18efc615aa42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:47.058017 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724d068-fc7a-4e6c-8fa1-18efc615aa42 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:47.074833 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 297/598] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:47.074833 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c84847-4e03-4450-9f78-ad313f1ddd3a None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.074833 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c84847-4e03-4450-9f78-ad313f1ddd3a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.074833 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c84847-4e03-4450-9f78-ad313f1ddd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.090795 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-e8c84847-4e03-4450-9f78-ad313f1ddd3a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:47.091994 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-e8c84847-4e03-4450-9f78-ad313f1ddd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:47.098078 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:47.112603 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6c362-d1d3-4036-b74d-e250486efd0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:47.113621 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:47.113744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6c362-d1d3-4036-b74d-e250486efd0d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:47.164376 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 298/599] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:47.165137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c84847-4e03-4450-9f78-ad313f1ddd3a None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:47.221855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 302/600] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 17:52:47.223190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5a1fa-d2f2-49c6-89ef-f340b2495e49 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.223487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5a1fa-d2f2-49c6-89ef-f340b2495e49 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.223778 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5a1fa-d2f2-49c6-89ef-f340b2495e49 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.225022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 303/601] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:47.225720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5a1fa-d2f2-49c6-89ef-f340b2495e49 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:47.275016 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c84847-4e03-4450-9f78-ad313f1ddd3a None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:47.308206 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d3712-4785-4512-bfe6-c45c3ce5f744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:47.308847 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d3712-4785-4512-bfe6-c45c3ce5f744 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.309128 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d3712-4785-4512-bfe6-c45c3ce5f744 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.309403 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d3712-4785-4512-bfe6-c45c3ce5f744 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.316747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:47.318859 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d3712-4785-4512-bfe6-c45c3ce5f744 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:47.320486 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d3712-4785-4512-bfe6-c45c3ce5f744 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:47.329069 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5a1fa-d2f2-49c6-89ef-f340b2495e49 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-189d3712-4785-4512-bfe6-c45c3ce5f744 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:47.333473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:47.334483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 299/602] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:47.335451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d3712-4785-4512-bfe6-c45c3ce5f744 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:47.355110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:47.365554 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899de34-be29-49db-90c0-f84587aaf96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:47.366190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899de34-be29-49db-90c0-f84587aaf96f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.366476 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899de34-be29-49db-90c0-f84587aaf96f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.366781 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899de34-be29-49db-90c0-f84587aaf96f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.378008 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899de34-be29-49db-90c0-f84587aaf96f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-b899de34-be29-49db-90c0-f84587aaf96f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:47.382950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:47.383884 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:47.384741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 304/603] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:47.385428 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ddc43-4967-491d-93d1-2f9d131e9951 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.385709 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ddc43-4967-491d-93d1-2f9d131e9951 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.385798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ddc43-4967-491d-93d1-2f9d131e9951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.404697 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-d38ddc43-4967-491d-93d1-2f9d131e9951 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:47.405922 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-d38ddc43-4967-491d-93d1-2f9d131e9951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:47.442043 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d3712-4785-4512-bfe6-c45c3ce5f744 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:47.473687 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 305/604] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:47.474609 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ddc43-4967-491d-93d1-2f9d131e9951 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:47.476161 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db82cc1-c66b-43d6-8a56-87a5ee011e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:47.476807 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db82cc1-c66b-43d6-8a56-87a5ee011e9f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.477092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db82cc1-c66b-43d6-8a56-87a5ee011e9f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.477362 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db82cc1-c66b-43d6-8a56-87a5ee011e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.488922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db82cc1-c66b-43d6-8a56-87a5ee011e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:47.490392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db82cc1-c66b-43d6-8a56-87a5ee011e9f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-7db82cc1-c66b-43d6-8a56-87a5ee011e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:47.507600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:47.508583 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:47.509504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:47.509504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:47.509504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:47.509504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:47.509504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 300/605] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:47.509799 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db82cc1-c66b-43d6-8a56-87a5ee011e9f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:47.566743 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:47.579771 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:47.594335 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ddc43-4967-491d-93d1-2f9d131e9951 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:47.617182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db82cc1-c66b-43d6-8a56-87a5ee011e9f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:47.628673 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d23f-df42-4e65-92d6-ac304f59f836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:47.629293 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d23f-df42-4e65-92d6-ac304f59f836 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.629572 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d23f-df42-4e65-92d6-ac304f59f836 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.629845 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d23f-df42-4e65-92d6-ac304f59f836 None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.630676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d23f-df42-4e65-92d6-ac304f59f836 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:47.630982 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d23f-df42-4e65-92d6-ac304f59f836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:47.632400 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d23f-df42-4e65-92d6-ac304f59f836 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:47.649918 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 306/606] 10.222.0.73 () {56 vars in 1137 bytes} [Wed Jul 27 17:52:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:47.650759 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d23f-df42-4e65-92d6-ac304f59f836 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:47.651298 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11798e-dfb1-47e1-8ea5-a2daed4ad94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:47.651925 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11798e-dfb1-47e1-8ea5-a2daed4ad94b None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.652209 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11798e-dfb1-47e1-8ea5-a2daed4ad94b None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.652485 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11798e-dfb1-47e1-8ea5-a2daed4ad94b None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.653194 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11798e-dfb1-47e1-8ea5-a2daed4ad94b None admin] RBAC: Adding query filter params (name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:47.653500 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11798e-dfb1-47e1-8ea5-a2daed4ad94b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:47.655035 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11798e-dfb1-47e1-8ea5-a2daed4ad94b None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:47.664614 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 301/607] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:47.665442 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11798e-dfb1-47e1-8ea5-a2daed4ad94b None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:47.755022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d23f-df42-4e65-92d6-ac304f59f836 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:47.765973 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11798e-dfb1-47e1-8ea5-a2daed4ad94b None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:47.793334 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd3e3e-57ef-4413-88d1-c97942eb834e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:47.793334 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3e3e-57ef-4413-88d1-c97942eb834e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.793334 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3e3e-57ef-4413-88d1-c97942eb834e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.793334 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3e3e-57ef-4413-88d1-c97942eb834e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.794767 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:47.801220 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:47.801670 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5c703-6d0f-42b2-852e-9c44e2d48e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:47.802297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c703-6d0f-42b2-852e-9c44e2d48e8b None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.802610 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c703-6d0f-42b2-852e-9c44e2d48e8b None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.802896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c703-6d0f-42b2-852e-9c44e2d48e8b None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.803596 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5c703-6d0f-42b2-852e-9c44e2d48e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:47.803906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5c703-6d0f-42b2-852e-9c44e2d48e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:47.805281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5c703-6d0f-42b2-852e-9c44e2d48e8b None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:47.805791 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd3e3e-57ef-4413-88d1-c97942eb834e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-94cd3e3e-57ef-4413-88d1-c97942eb834e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:47.810740 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:47.811827 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:52:47.812865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:47.817352 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 307/608] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:47.818086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd3e3e-57ef-4413-88d1-c97942eb834e None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:47.823919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 302/609] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:47.823919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5c703-6d0f-42b2-852e-9c44e2d48e8b None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:47.922134 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5c703-6d0f-42b2-852e-9c44e2d48e8b None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:47.929736 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd3e3e-57ef-4413-88d1-c97942eb834e None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:47.956727 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d9840-879d-4ce1-995e-8a02605b7bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:47.957363 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d9840-879d-4ce1-995e-8a02605b7bce None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.957639 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d9840-879d-4ce1-995e-8a02605b7bce None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.958257 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d9840-879d-4ce1-995e-8a02605b7bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.963504 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8162b3-2249-4b4f-8637-edb749f42c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:47.964119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8162b3-2249-4b4f-8637-edb749f42c09 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:47.964403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8162b3-2249-4b4f-8637-edb749f42c09 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:47.964680 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8162b3-2249-4b4f-8637-edb749f42c09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:47.968822 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d9840-879d-4ce1-995e-8a02605b7bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:47.970260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d9840-879d-4ce1-995e-8a02605b7bce None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-6c5d9840-879d-4ce1-995e-8a02605b7bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:47.984660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:47.985765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:47.987215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:47.987215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:47.987215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:47.987215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:47.987215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 303/610] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:47.987215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d9840-879d-4ce1-995e-8a02605b7bce None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.030800 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:48.035338 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:48.039713 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8162b3-2249-4b4f-8637-edb749f42c09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.041170 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8162b3-2249-4b4f-8637-edb749f42c09 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.093570 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d9840-879d-4ce1-995e-8a02605b7bce None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:48.128498 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bfc18-ca5a-4072-bec6-dc3203934b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:48.129119 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfc18-ca5a-4072-bec6-dc3203934b05 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:48.129405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfc18-ca5a-4072-bec6-dc3203934b05 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:48.129683 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfc18-ca5a-4072-bec6-dc3203934b05 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:48.130401 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bfc18-ca5a-4072-bec6-dc3203934b05 None admin] RBAC: Adding query filter params (name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:48.130742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bfc18-ca5a-4072-bec6-dc3203934b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.132131 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bfc18-ca5a-4072-bec6-dc3203934b05 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.140141 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 304/611] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:52:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:48.140938 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bfc18-ca5a-4072-bec6-dc3203934b05 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.145012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 308/612] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:48.145012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8162b3-2249-4b4f-8637-edb749f42c09 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.242981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:48.244286 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bfc18-ca5a-4072-bec6-dc3203934b05 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:48.246691 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:48.246825 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8162b3-2249-4b4f-8637-edb749f42c09 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:48.278683 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5348-9653-4ac7-9d3a-dd9f88364d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:48.279330 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5348-9653-4ac7-9d3a-dd9f88364d64 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:48.279608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5348-9653-4ac7-9d3a-dd9f88364d64 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:48.279982 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5348-9653-4ac7-9d3a-dd9f88364d64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:48.281115 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee72e73-b5f6-4682-b201-f30a99d0dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:48.281671 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee72e73-b5f6-4682-b201-f30a99d0dee2 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:48.281953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee72e73-b5f6-4682-b201-f30a99d0dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:48.282223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee72e73-b5f6-4682-b201-f30a99d0dee2 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:48.283504 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee72e73-b5f6-4682-b201-f30a99d0dee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:48.283809 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee72e73-b5f6-4682-b201-f30a99d0dee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.285162 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee72e73-b5f6-4682-b201-f30a99d0dee2 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.287452 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b5348-9653-4ac7-9d3a-dd9f88364d64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.288886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b5348-9653-4ac7-9d3a-dd9f88364d64 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.296477 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 309/613] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:48.297286 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee72e73-b5f6-4682-b201-f30a99d0dee2 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-d16b5348-9653-4ac7-9d3a-dd9f88364d64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:48.300838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:48.301775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:48.302718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:48.302718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:48.302718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:48.302718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:48.302718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:48.302718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:48.302718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:48.302718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:48.302718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 305/614] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:48.303287 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5348-9653-4ac7-9d3a-dd9f88364d64 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.403459 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5348-9653-4ac7-9d3a-dd9f88364d64 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:48.408444 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee72e73-b5f6-4682-b201-f30a99d0dee2 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:48.437852 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3929c-ac30-4c49-b180-a73b8afc56d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:48.438489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3929c-ac30-4c49-b180-a73b8afc56d3 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:48.438804 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3929c-ac30-4c49-b180-a73b8afc56d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:48.439116 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3929c-ac30-4c49-b180-a73b8afc56d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:48.442628 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9d11d-5dd3-4ac9-aa16-9331b30b0265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:48.443267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9d11d-5dd3-4ac9-aa16-9331b30b0265 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:48.443553 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9d11d-5dd3-4ac9-aa16-9331b30b0265 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:48.443831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9d11d-5dd3-4ac9-aa16-9331b30b0265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:48.450229 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3929c-ac30-4c49-b180-a73b8afc56d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.451723 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3929c-ac30-4c49-b180-a73b8afc56d3 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.454495 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9d11d-5dd3-4ac9-aa16-9331b30b0265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.455986 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9d11d-5dd3-4ac9-aa16-9331b30b0265 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-afb3929c-ac30-4c49-b180-a73b8afc56d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:48.465697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:48.466652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:48.467545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:48.467545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:48.467545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:48.467545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:48.467545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 306/615] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:48.467830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3929c-ac30-4c49-b180-a73b8afc56d3 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-5da9d11d-5dd3-4ac9-aa16-9331b30b0265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:48.469879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:48.470801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:48.471858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:48.471858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:48.471858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:48.471858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:48.471858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 310/616] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:48.472153 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9d11d-5dd3-4ac9-aa16-9331b30b0265 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.487595 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:48.489140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:48.571120 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3929c-ac30-4c49-b180-a73b8afc56d3 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:48.582834 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9d11d-5dd3-4ac9-aa16-9331b30b0265 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:48.609999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254153b-622f-446c-9f74-7b9419af2f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:48.610689 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254153b-622f-446c-9f74-7b9419af2f6a None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:48.611494 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254153b-622f-446c-9f74-7b9419af2f6a None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:48.611851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254153b-622f-446c-9f74-7b9419af2f6a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:48.614719 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8580142-27c0-4e62-9483-b54d134ed27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:48.615334 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8580142-27c0-4e62-9483-b54d134ed27c None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:48.615615 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8580142-27c0-4e62-9483-b54d134ed27c None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:48.615891 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8580142-27c0-4e62-9483-b54d134ed27c None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:48.616639 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8580142-27c0-4e62-9483-b54d134ed27c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:48.616948 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8580142-27c0-4e62-9483-b54d134ed27c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.618369 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8580142-27c0-4e62-9483-b54d134ed27c None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.620392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254153b-622f-446c-9f74-7b9419af2f6a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.621822 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254153b-622f-446c-9f74-7b9419af2f6a None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.632457 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 311/617] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:48.633293 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8580142-27c0-4e62-9483-b54d134ed27c None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-c254153b-622f-446c-9f74-7b9419af2f6a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:48.633991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:48.635085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 307/618] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:48.640704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254153b-622f-446c-9f74-7b9419af2f6a None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.704012 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:48.715226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:48.735686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8580142-27c0-4e62-9483-b54d134ed27c None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:48.739056 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254153b-622f-446c-9f74-7b9419af2f6a None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:48.770844 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0b129-a65a-44b9-bcb9-0cb2d3afdb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:48.771561 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0b129-a65a-44b9-bcb9-0cb2d3afdb7f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:48.771845 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0b129-a65a-44b9-bcb9-0cb2d3afdb7f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:48.772118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0b129-a65a-44b9-bcb9-0cb2d3afdb7f None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:48.772834 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0b129-a65a-44b9-bcb9-0cb2d3afdb7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:48.773145 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0b129-a65a-44b9-bcb9-0cb2d3afdb7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.773238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93771f2-b2d4-472b-bd2e-e37708661f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:48.773830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93771f2-b2d4-472b-bd2e-e37708661f49 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:48.774115 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93771f2-b2d4-472b-bd2e-e37708661f49 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:48.774393 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93771f2-b2d4-472b-bd2e-e37708661f49 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:48.774537 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0b129-a65a-44b9-bcb9-0cb2d3afdb7f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.775128 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93771f2-b2d4-472b-bd2e-e37708661f49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:48.775440 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93771f2-b2d4-472b-bd2e-e37708661f49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.777064 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93771f2-b2d4-472b-bd2e-e37708661f49 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.786407 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 312/619] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:48.787181 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0b129-a65a-44b9-bcb9-0cb2d3afdb7f None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.792373 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 308/620] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:48.794463 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93771f2-b2d4-472b-bd2e-e37708661f49 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.892189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0b129-a65a-44b9-bcb9-0cb2d3afdb7f None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:48.895745 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93771f2-b2d4-472b-bd2e-e37708661f49 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:48.920667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:48.927762 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967669b2-e664-4311-a83c-d2e0889d864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:48.928377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967669b2-e664-4311-a83c-d2e0889d864f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:48.928661 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967669b2-e664-4311-a83c-d2e0889d864f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:48.928939 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967669b2-e664-4311-a83c-d2e0889d864f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:48.929723 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967669b2-e664-4311-a83c-d2e0889d864f None admin] RBAC: Adding query filter params (role.id=af430df1b4ae42f3bc51a56f0cb42e33, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=de6300c387da4594bca473cd708b79f9) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:48.930033 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967669b2-e664-4311-a83c-d2e0889d864f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.930954 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d359-2f64-4cb9-bc9d-315aa12dcefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:48.931485 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967669b2-e664-4311-a83c-d2e0889d864f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.931614 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d359-2f64-4cb9-bc9d-315aa12dcefe None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:48.931846 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d359-2f64-4cb9-bc9d-315aa12dcefe None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:48.932123 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d359-2f64-4cb9-bc9d-315aa12dcefe None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:48.932912 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6d359-2f64-4cb9-bc9d-315aa12dcefe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:48.933223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6d359-2f64-4cb9-bc9d-315aa12dcefe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:48.934647 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6d359-2f64-4cb9-bc9d-315aa12dcefe None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:48.937170 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:48.937302 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 313/621] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/role_assignments?user.id=de6300c387da4594bca473cd708b79f9&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=af430df1b4ae42f3bc51a56f0cb42e33 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:48.938016 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967669b2-e664-4311-a83c-d2e0889d864f None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:48.960730 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 309/622] 10.222.0.73 () {56 vars in 1137 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:48.961862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d359-2f64-4cb9-bc9d-315aa12dcefe None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:49.061060 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967669b2-e664-4311-a83c-d2e0889d864f None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:49.086194 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d359-2f64-4cb9-bc9d-315aa12dcefe None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:49.110160 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59651a7-73ba-404e-b5c2-142b69f197e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:49.111313 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59651a7-73ba-404e-b5c2-142b69f197e1 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:49.111725 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59651a7-73ba-404e-b5c2-142b69f197e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:49.112207 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59651a7-73ba-404e-b5c2-142b69f197e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:49.120351 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59651a7-73ba-404e-b5c2-142b69f197e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:49.121804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59651a7-73ba-404e-b5c2-142b69f197e1 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:49.132637 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede232ee-4e06-404a-a0b3-5000d99410b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:49.133394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede232ee-4e06-404a-a0b3-5000d99410b4 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:49.133755 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede232ee-4e06-404a-a0b3-5000d99410b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:49.134038 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede232ee-4e06-404a-a0b3-5000d99410b4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-f59651a7-73ba-404e-b5c2-142b69f197e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:49.136189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:49.137176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:49.138245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:49.138245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:49.138245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:49.138245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:49.138245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:49.138245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:49.138245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:49.138245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:49.142061 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede232ee-4e06-404a-a0b3-5000d99410b4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:49.143395 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 314/623] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:49.144483 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59651a7-73ba-404e-b5c2-142b69f197e1 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:49.144756 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede232ee-4e06-404a-a0b3-5000d99410b4 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-ede232ee-4e06-404a-a0b3-5000d99410b4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:49.158215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:49.159519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 310/624] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:52:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:49.160704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede232ee-4e06-404a-a0b3-5000d99410b4 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:49.211767 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:49.235222 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:49.266033 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59651a7-73ba-404e-b5c2-142b69f197e1 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:49.288185 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede232ee-4e06-404a-a0b3-5000d99410b4 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:49.306227 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8bec9-7696-4017-bd2a-ef9d5439c61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:49.306888 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bec9-7696-4017-bd2a-ef9d5439c61b None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:49.307171 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bec9-7696-4017-bd2a-ef9d5439c61b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:49.307453 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bec9-7696-4017-bd2a-ef9d5439c61b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:49.326827 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cefa1-6e14-449b-a09e-cc3620578bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:49.327443 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cefa1-6e14-449b-a09e-cc3620578bf3 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:49.327732 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cefa1-6e14-449b-a09e-cc3620578bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:49.328013 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cefa1-6e14-449b-a09e-cc3620578bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:49.328763 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cefa1-6e14-449b-a09e-cc3620578bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:49.329074 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cefa1-6e14-449b-a09e-cc3620578bf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:49.331084 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cefa1-6e14-449b-a09e-cc3620578bf3 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:49.348867 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 311/625] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:49.348867 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cefa1-6e14-449b-a09e-cc3620578bf3 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:49.388977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8bec9-7696-4017-bd2a-ef9d5439c61b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:49.391034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8bec9-7696-4017-bd2a-ef9d5439c61b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:49.453684 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cefa1-6e14-449b-a09e-cc3620578bf3 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:49.457623 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:49.470416 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:49.494817 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dcf5f-633a-4497-a532-e5254ae15339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:49.495444 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dcf5f-633a-4497-a532-e5254ae15339 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:49.495727 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dcf5f-633a-4497-a532-e5254ae15339 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:49.496010 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dcf5f-633a-4497-a532-e5254ae15339 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:49.496806 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dcf5f-633a-4497-a532-e5254ae15339 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:49.497117 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dcf5f-633a-4497-a532-e5254ae15339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:49.498569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dcf5f-633a-4497-a532-e5254ae15339 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:49.515940 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 315/626] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:49.515940 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8bec9-7696-4017-bd2a-ef9d5439c61b None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:49.523847 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 312/627] 10.222.0.73 () {56 vars in 1139 bytes} [Wed Jul 27 17:52:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:49.523847 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dcf5f-633a-4497-a532-e5254ae15339 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:49.641324 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8bec9-7696-4017-bd2a-ef9d5439c61b None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:49.658364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dcf5f-633a-4497-a532-e5254ae15339 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:49.678782 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a2e88-15ac-4181-9ce0-22fb8917c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:49.679406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a2e88-15ac-4181-9ce0-22fb8917c83e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:49.679687 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a2e88-15ac-4181-9ce0-22fb8917c83e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:49.679962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a2e88-15ac-4181-9ce0-22fb8917c83e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:49.680788 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a2e88-15ac-4181-9ce0-22fb8917c83e None admin] RBAC: Adding query filter params (role.id=af430df1b4ae42f3bc51a56f0cb42e33, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=dd0601985b76490dae3f9d0ce2fe9505) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:49.681099 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a2e88-15ac-4181-9ce0-22fb8917c83e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:49.682542 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a2e88-15ac-4181-9ce0-22fb8917c83e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:49.698556 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 316/628] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:49 2022] GET /identity/v3/role_assignments?user.id=dd0601985b76490dae3f9d0ce2fe9505&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=af430df1b4ae42f3bc51a56f0cb42e33 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:49.698556 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a2e88-15ac-4181-9ce0-22fb8917c83e None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:49.704406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a69d7-4902-40a1-9fed-3d020a26edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:49.705169 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a69d7-4902-40a1-9fed-3d020a26edba None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:49.705651 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a69d7-4902-40a1-9fed-3d020a26edba None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:49.705931 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a69d7-4902-40a1-9fed-3d020a26edba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:49.722047 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:49.724241 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a69d7-4902-40a1-9fed-3d020a26edba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:49.726560 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a69d7-4902-40a1-9fed-3d020a26edba None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-1e8a69d7-4902-40a1-9fed-3d020a26edba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:49.750812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:49.751815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:49.752712 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:49.752712 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:49.752712 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:49.752712 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:49.752712 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 313/629] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:49.758095 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a69d7-4902-40a1-9fed-3d020a26edba None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:49.802302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:49.849695 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a2e88-15ac-4181-9ce0-22fb8917c83e None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:49.896575 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a69d7-4902-40a1-9fed-3d020a26edba None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:49.897471 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ff4eb-0808-4efb-a3bb-3f70de9baba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:49.898142 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff4eb-0808-4efb-a3bb-3f70de9baba9 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:49.898383 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff4eb-0808-4efb-a3bb-3f70de9baba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:49.898695 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff4eb-0808-4efb-a3bb-3f70de9baba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:49.946195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5372c1-4479-4b19-99a5-1697a8811137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:49.947208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5372c1-4479-4b19-99a5-1697a8811137 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:49.947680 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5372c1-4479-4b19-99a5-1697a8811137 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:49.948133 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5372c1-4479-4b19-99a5-1697a8811137 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:49.949011 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5372c1-4479-4b19-99a5-1697a8811137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:49.949522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5372c1-4479-4b19-99a5-1697a8811137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:49.951117 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5372c1-4479-4b19-99a5-1697a8811137 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:49.970797 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 314/630] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:49.976923 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5372c1-4479-4b19-99a5-1697a8811137 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:49.999870 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ff4eb-0808-4efb-a3bb-3f70de9baba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:50.001628 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ff4eb-0808-4efb-a3bb-3f70de9baba9 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:50.029951 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:50.083631 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:50.103346 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5372c1-4479-4b19-99a5-1697a8811137 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:50.130805 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 317/631] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 17:52:50.135673 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ff4eb-0808-4efb-a3bb-3f70de9baba9 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:50.146834 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5736788-6a2e-4daf-ac6f-a663436350e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:50.147489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736788-6a2e-4daf-ac6f-a663436350e9 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:50.147776 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736788-6a2e-4daf-ac6f-a663436350e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:50.148058 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736788-6a2e-4daf-ac6f-a663436350e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:50.155561 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5736788-6a2e-4daf-ac6f-a663436350e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:50.157023 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5736788-6a2e-4daf-ac6f-a663436350e9 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-c5736788-6a2e-4daf-ac6f-a663436350e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:50.170009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:50.171007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:50.171911 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:50.171911 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:50.171911 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:50.171911 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:50.171911 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:50.171911 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:50.171911 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:50.171911 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:50.171911 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 315/632] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:50.177401 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5736788-6a2e-4daf-ac6f-a663436350e9 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:50.259723 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ff4eb-0808-4efb-a3bb-3f70de9baba9 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:50.278958 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:50.297075 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5736788-6a2e-4daf-ac6f-a663436350e9 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:50.298317 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dabad-eacf-4253-bf73-5f4de6b97002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:50.299689 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dabad-eacf-4253-bf73-5f4de6b97002 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:50.300069 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dabad-eacf-4253-bf73-5f4de6b97002 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:50.300501 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dabad-eacf-4253-bf73-5f4de6b97002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:50.311682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dabad-eacf-4253-bf73-5f4de6b97002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:50.313434 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dabad-eacf-4253-bf73-5f4de6b97002 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-347dabad-eacf-4253-bf73-5f4de6b97002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:50.330272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:50.331237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:50.332134 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:50.332134 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:50.332134 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:50.332134 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:50.336517 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 318/633] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:50.337382 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dabad-eacf-4253-bf73-5f4de6b97002 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:50.337556 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182806b-1084-45f7-8cc1-b33a546a8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:50.338475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182806b-1084-45f7-8cc1-b33a546a8efe None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:50.338793 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182806b-1084-45f7-8cc1-b33a546a8efe None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:50.339084 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182806b-1084-45f7-8cc1-b33a546a8efe None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:50.339899 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182806b-1084-45f7-8cc1-b33a546a8efe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:50.340372 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182806b-1084-45f7-8cc1-b33a546a8efe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:50.341922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182806b-1084-45f7-8cc1-b33a546a8efe None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:50.362041 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 316/634] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:50.363468 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182806b-1084-45f7-8cc1-b33a546a8efe None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:50.368064 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:50.446051 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dabad-eacf-4253-bf73-5f4de6b97002 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:50.478048 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182806b-1084-45f7-8cc1-b33a546a8efe None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:50.483906 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ca0d1-bda6-4c8b-b6ac-3f647f37f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:50.484537 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ca0d1-bda6-4c8b-b6ac-3f647f37f8cb None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:50.484825 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ca0d1-bda6-4c8b-b6ac-3f647f37f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:50.485105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ca0d1-bda6-4c8b-b6ac-3f647f37f8cb None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:50.485808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ca0d1-bda6-4c8b-b6ac-3f647f37f8cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:50.486694 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ca0d1-bda6-4c8b-b6ac-3f647f37f8cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:50.488316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ca0d1-bda6-4c8b-b6ac-3f647f37f8cb None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:50.505501 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 319/635] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:50.506419 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ca0d1-bda6-4c8b-b6ac-3f647f37f8cb None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:50.517185 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d5fce-f6a0-4f02-b1ab-0d972acdf614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:50.517774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d5fce-f6a0-4f02-b1ab-0d972acdf614 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:50.518174 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d5fce-f6a0-4f02-b1ab-0d972acdf614 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:50.518418 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d5fce-f6a0-4f02-b1ab-0d972acdf614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:50.519299 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d5fce-f6a0-4f02-b1ab-0d972acdf614 None admin] RBAC: Adding query filter params (role.id=af430df1b4ae42f3bc51a56f0cb42e33, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=856e3f650ab34f15828f1adb320d03ca) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:50.519619 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d5fce-f6a0-4f02-b1ab-0d972acdf614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:50.521182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d5fce-f6a0-4f02-b1ab-0d972acdf614 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:50.533660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 317/636] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:50 2022] GET /identity/v3/role_assignments?user.id=856e3f650ab34f15828f1adb320d03ca&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=af430df1b4ae42f3bc51a56f0cb42e33 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:50.540229 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:50.623462 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ca0d1-bda6-4c8b-b6ac-3f647f37f8cb None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:50.663597 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56bae-62ec-4487-b2c6-6c7f14cfa577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:50.664353 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56bae-62ec-4487-b2c6-6c7f14cfa577 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:50.664535 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56bae-62ec-4487-b2c6-6c7f14cfa577 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:50.664821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56bae-62ec-4487-b2c6-6c7f14cfa577 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:50.672917 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56bae-62ec-4487-b2c6-6c7f14cfa577 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:50.675040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56bae-62ec-4487-b2c6-6c7f14cfa577 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-9ee56bae-62ec-4487-b2c6-6c7f14cfa577 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:50.687744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:50.688717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:50.689677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:50.689677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:50.689677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:50.689677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:50.689677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:50.689677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:50.689677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:50.689677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:50.689677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 320/637] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:50.695350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d5fce-f6a0-4f02-b1ab-0d972acdf614 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:50.773426 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:50.815665 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d5fce-f6a0-4f02-b1ab-0d972acdf614 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:50.852324 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab68c7-f8d4-4bda-b09a-864225c0c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:50.852948 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab68c7-f8d4-4bda-b09a-864225c0c853 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:50.853233 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab68c7-f8d4-4bda-b09a-864225c0c853 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:50.853509 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab68c7-f8d4-4bda-b09a-864225c0c853 None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:50.854266 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab68c7-f8d4-4bda-b09a-864225c0c853 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:50.854610 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab68c7-f8d4-4bda-b09a-864225c0c853 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:50.856041 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab68c7-f8d4-4bda-b09a-864225c0c853 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:50.869617 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 318/638] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:50.875474 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56bae-62ec-4487-b2c6-6c7f14cfa577 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:50.973576 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:50.983559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56bae-62ec-4487-b2c6-6c7f14cfa577 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:51.020908 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0794a-7bee-4a68-8a26-c4cc3d316f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:51.021539 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0794a-7bee-4a68-8a26-c4cc3d316f7d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:51.021824 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0794a-7bee-4a68-8a26-c4cc3d316f7d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:51.022103 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0794a-7bee-4a68-8a26-c4cc3d316f7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:51.022943 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0794a-7bee-4a68-8a26-c4cc3d316f7d None admin] RBAC: Adding query filter params (role.id=af430df1b4ae42f3bc51a56f0cb42e33, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=54abb42639f1401bb6433e2d4642d741) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:51.023255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0794a-7bee-4a68-8a26-c4cc3d316f7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:51.024739 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0794a-7bee-4a68-8a26-c4cc3d316f7d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:51.031807 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 321/639] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:50 2022] GET /identity/v3/role_assignments?user.id=54abb42639f1401bb6433e2d4642d741&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=af430df1b4ae42f3bc51a56f0cb42e33 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:51.315470 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09310230-fd02-4a3e-a559-49a98501dfcb None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:51.315816 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09310230-fd02-4a3e-a559-49a98501dfcb None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:51.316083 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09310230-fd02-4a3e-a559-49a98501dfcb None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:51.317585 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 319/640] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:51.323291 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adc981-f193-40c0-bdd2-74dc8a8b73f4 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:51.323860 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adc981-f193-40c0-bdd2-74dc8a8b73f4 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:51.324335 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adc981-f193-40c0-bdd2-74dc8a8b73f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:51.343337 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-22adc981-f193-40c0-bdd2-74dc8a8b73f4 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:51.344887 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-22adc981-f193-40c0-bdd2-74dc8a8b73f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:51.418683 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 322/641] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:51.439834 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09310230-fd02-4a3e-a559-49a98501dfcb None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:51.551589 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09310230-fd02-4a3e-a559-49a98501dfcb None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:51.579729 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:51.588505 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03de5-6f64-42cb-9154-468c0e281878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:51.589168 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03de5-6f64-42cb-9154-468c0e281878 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:51.589461 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03de5-6f64-42cb-9154-468c0e281878 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:51.589742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03de5-6f64-42cb-9154-468c0e281878 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:51.602183 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf03de5-6f64-42cb-9154-468c0e281878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-aaf03de5-6f64-42cb-9154-468c0e281878 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:51.609113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:51.610166 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:51.612145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 320/642] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:52:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:51.619594 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adc981-f193-40c0-bdd2-74dc8a8b73f4 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:51.715141 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:51.732313 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adc981-f193-40c0-bdd2-74dc8a8b73f4 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:51.768189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f17af-1dae-45bb-a273-c2c3af7c6526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:51.769200 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f17af-1dae-45bb-a273-c2c3af7c6526 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:51.769698 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f17af-1dae-45bb-a273-c2c3af7c6526 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:51.770170 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f17af-1dae-45bb-a273-c2c3af7c6526 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:51.771135 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f17af-1dae-45bb-a273-c2c3af7c6526 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:51.771641 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f17af-1dae-45bb-a273-c2c3af7c6526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:51.773218 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f17af-1dae-45bb-a273-c2c3af7c6526 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:51.787887 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 323/643] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:51.789525 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03de5-6f64-42cb-9154-468c0e281878 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:51.906341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03de5-6f64-42cb-9154-468c0e281878 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:51.942347 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4bef8-04d2-451d-888e-543fca3b069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:51.943026 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4bef8-04d2-451d-888e-543fca3b069c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:51.943314 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4bef8-04d2-451d-888e-543fca3b069c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:51.943592 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4bef8-04d2-451d-888e-543fca3b069c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:51.954677 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4bef8-04d2-451d-888e-543fca3b069c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:51.956694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4bef8-04d2-451d-888e-543fca3b069c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-02e4bef8-04d2-451d-888e-543fca3b069c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:51.972092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:51.973030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:51.974350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:51.974350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:51.974350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:51.974350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:51.974350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 321/644] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:51.980617 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f17af-1dae-45bb-a273-c2c3af7c6526 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:52.093974 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f17af-1dae-45bb-a273-c2c3af7c6526 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:52.129948 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab1b5c-dc5c-4246-bb64-bd0fcb17d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:52.130602 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab1b5c-dc5c-4246-bb64-bd0fcb17d26e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:52.130892 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab1b5c-dc5c-4246-bb64-bd0fcb17d26e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:52.131173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab1b5c-dc5c-4246-bb64-bd0fcb17d26e None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:52.131877 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab1b5c-dc5c-4246-bb64-bd0fcb17d26e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:52.132188 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab1b5c-dc5c-4246-bb64-bd0fcb17d26e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:52.133559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab1b5c-dc5c-4246-bb64-bd0fcb17d26e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:52.147079 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 324/645] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:52.152944 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4bef8-04d2-451d-888e-543fca3b069c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:52.196725 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:52.201843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb87636-46a6-4cec-86b7-9a5416f22b21 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:52.202327 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb87636-46a6-4cec-86b7-9a5416f22b21 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:52.202634 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb87636-46a6-4cec-86b7-9a5416f22b21 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:52.204333 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 325/646] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:52.210253 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df8985-3c0d-4a3c-9024-bb889da51c1c None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:52.210653 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df8985-3c0d-4a3c-9024-bb889da51c1c None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:52.210831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df8985-3c0d-4a3c-9024-bb889da51c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:52.228460 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:52.232410 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-40df8985-3c0d-4a3c-9024-bb889da51c1c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:52.233780 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-40df8985-3c0d-4a3c-9024-bb889da51c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:52.267165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4bef8-04d2-451d-888e-543fca3b069c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:52.313349 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35d6aa-c016-42a3-9b87-efa58c002029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:52.313997 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35d6aa-c016-42a3-9b87-efa58c002029 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:52.315001 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35d6aa-c016-42a3-9b87-efa58c002029 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:52.315420 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35d6aa-c016-42a3-9b87-efa58c002029 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:52.322536 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 326/647] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:52.331222 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35d6aa-c016-42a3-9b87-efa58c002029 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:52.332825 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35d6aa-c016-42a3-9b87-efa58c002029 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:52.340250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df8985-3c0d-4a3c-9024-bb889da51c1c None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-5f35d6aa-c016-42a3-9b87-efa58c002029 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:52.347849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:52.348843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:52.349835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:52.349835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:52.349835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:52.349835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:52.349835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:52.349835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:52.349835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:52.349835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:52.349835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:52:52.349835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:52.349835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 322/648] 10.222.0.73 () {56 vars in 1093 bytes} [Wed Jul 27 17:52:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:52.354593 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35d6aa-c016-42a3-9b87-efa58c002029 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:52.466076 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:52.470037 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35d6aa-c016-42a3-9b87-efa58c002029 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:52.480786 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df8985-3c0d-4a3c-9024-bb889da51c1c None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:52.517713 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a86a18-bd01-4b77-af86-777460511413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:52.518371 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86a18-bd01-4b77-af86-777460511413 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:52.518799 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86a18-bd01-4b77-af86-777460511413 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:52.519086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86a18-bd01-4b77-af86-777460511413 None admin] PATH_INFO: `/v3/services/image` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:52.519790 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a86a18-bd01-4b77-af86-777460511413 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:52.521282 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a86a18-bd01-4b77-af86-777460511413 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:52.521598 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafafae-9783-46a1-a888-ce78b5e0bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:52.522598 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafafae-9783-46a1-a888-ce78b5e0bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:52.523076 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafafae-9783-46a1-a888-ce78b5e0bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:52.523840 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafafae-9783-46a1-a888-ce78b5e0bdc7 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:52.524822 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafafae-9783-46a1-a888-ce78b5e0bdc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:52.525313 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafafae-9783-46a1-a888-ce78b5e0bdc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:52.526016 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:52.528307 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafafae-9783-46a1-a888-ce78b5e0bdc7 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-e9a86a18-bd01-4b77-af86-777460511413 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:52.538017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:52.539312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 17:52:52.540176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:52.544081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 327/649] 10.222.0.73 () {56 vars in 1105 bytes} [Wed Jul 27 17:52:52 2022] GET /identity/v3/services/image => generated 86 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:52.544943 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a86a18-bd01-4b77-af86-777460511413 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:52.554136 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 323/650] 10.222.0.73 () {56 vars in 1133 bytes} [Wed Jul 27 17:52:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:52.559683 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafafae-9783-46a1-a888-ce78b5e0bdc7 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:52.668648 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a86a18-bd01-4b77-af86-777460511413 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:52.699271 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafafae-9783-46a1-a888-ce78b5e0bdc7 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:52.715020 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2dd67-8cf4-428b-8201-a3752d52d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:52.716316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2dd67-8cf4-428b-8201-a3752d52d8be None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:52.717472 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2dd67-8cf4-428b-8201-a3752d52d8be None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:52.718358 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2dd67-8cf4-428b-8201-a3752d52d8be None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:52.719258 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2dd67-8cf4-428b-8201-a3752d52d8be None admin] RBAC: Adding query filter params (name=image) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:52.719749 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2dd67-8cf4-428b-8201-a3752d52d8be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:52.722368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2dd67-8cf4-428b-8201-a3752d52d8be None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:52.729187 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 328/651] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:52.734769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2dd67-8cf4-428b-8201-a3752d52d8be None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:52.738542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e165a3-3f26-47ac-af5f-9224bab28839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:52.740375 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e165a3-3f26-47ac-af5f-9224bab28839 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:52.740869 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e165a3-3f26-47ac-af5f-9224bab28839 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:52.741348 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e165a3-3f26-47ac-af5f-9224bab28839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:52.781748 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:52.820708 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:52.843044 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e165a3-3f26-47ac-af5f-9224bab28839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:52.846429 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e165a3-3f26-47ac-af5f-9224bab28839 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:52.865564 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2dd67-8cf4-428b-8201-a3752d52d8be None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:52.906519 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a402618-d138-45df-96eb-3d38d019614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:52.907205 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a402618-d138-45df-96eb-3d38d019614e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:52.907537 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a402618-d138-45df-96eb-3d38d019614e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:52.908122 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a402618-d138-45df-96eb-3d38d019614e None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:52.909090 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a402618-d138-45df-96eb-3d38d019614e None admin] RBAC: Adding query filter params (type=image) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:52.909399 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a402618-d138-45df-96eb-3d38d019614e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:52.910871 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a402618-d138-45df-96eb-3d38d019614e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:52.923367 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 329/652] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:52.983093 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 324/653] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 17:52:52.989417 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a402618-d138-45df-96eb-3d38d019614e None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:53.052849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522c77-f8f7-437e-ac4c-db38777c9a56 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.053193 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522c77-f8f7-437e-ac4c-db38777c9a56 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.053424 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522c77-f8f7-437e-ac4c-db38777c9a56 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.055370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 325/654] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:53.061016 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548fcf-97e8-46a4-b72f-0ef16ca77e68 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.061356 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548fcf-97e8-46a4-b72f-0ef16ca77e68 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.061610 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548fcf-97e8-46a4-b72f-0ef16ca77e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.088613 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-4c548fcf-97e8-46a4-b72f-0ef16ca77e68 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:53.090732 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-4c548fcf-97e8-46a4-b72f-0ef16ca77e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:53.120507 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a402618-d138-45df-96eb-3d38d019614e None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:53.158357 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:53.159274 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:53.167598 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa1071-d05f-4aa1-b713-efdcbcaeebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:53.168411 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa1071-d05f-4aa1-b713-efdcbcaeebe3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.168836 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa1071-d05f-4aa1-b713-efdcbcaeebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.169127 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa1071-d05f-4aa1-b713-efdcbcaeebe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.176472 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 326/655] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 17:52:53.191113 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa1071-d05f-4aa1-b713-efdcbcaeebe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:53.192991 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa1071-d05f-4aa1-b713-efdcbcaeebe3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:53.201806 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c548fcf-97e8-46a4-b72f-0ef16ca77e68 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-aafa1071-d05f-4aa1-b713-efdcbcaeebe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:53.218046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:53.219116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:53.220236 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:53.220236 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:53.220236 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:53.220236 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:53.222593 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 330/656] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:53.230575 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa1071-d05f-4aa1-b713-efdcbcaeebe3 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:53.321281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c548fcf-97e8-46a4-b72f-0ef16ca77e68 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:53.366415 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa1071-d05f-4aa1-b713-efdcbcaeebe3 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:53.370007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297b6e0-1828-43ac-a0af-a075812828a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:53.370783 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b6e0-1828-43ac-a0af-a075812828a4 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.371137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b6e0-1828-43ac-a0af-a075812828a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.371486 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b6e0-1828-43ac-a0af-a075812828a4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.372200 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297b6e0-1828-43ac-a0af-a075812828a4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:53.373711 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297b6e0-1828-43ac-a0af-a075812828a4 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-1297b6e0-1828-43ac-a0af-a075812828a4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:53.389186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:53.390382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 17:52:53.391447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:53.393133 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 327/657] 10.222.0.73 () {56 vars in 1129 bytes} [Wed Jul 27 17:52:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:53.398764 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297b6e0-1828-43ac-a0af-a075812828a4 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:53.409210 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78575a7-09f1-4f59-b617-cc0b6b474431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:53.410136 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78575a7-09f1-4f59-b617-cc0b6b474431 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.410641 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78575a7-09f1-4f59-b617-cc0b6b474431 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.411056 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78575a7-09f1-4f59-b617-cc0b6b474431 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.411899 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78575a7-09f1-4f59-b617-cc0b6b474431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:53.412365 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78575a7-09f1-4f59-b617-cc0b6b474431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:53.413893 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78575a7-09f1-4f59-b617-cc0b6b474431 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:53.431917 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 331/658] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:53.435158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78575a7-09f1-4f59-b617-cc0b6b474431 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:53.466183 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:53.489246 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:53.522380 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297b6e0-1828-43ac-a0af-a075812828a4 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:53.552348 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78575a7-09f1-4f59-b617-cc0b6b474431 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:53.557338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d603639-0583-4d50-82be-2562308917c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:53.557964 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d603639-0583-4d50-82be-2562308917c1 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.558241 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d603639-0583-4d50-82be-2562308917c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.558550 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d603639-0583-4d50-82be-2562308917c1 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.559257 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d603639-0583-4d50-82be-2562308917c1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:53.559562 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d603639-0583-4d50-82be-2562308917c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:53.560915 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d603639-0583-4d50-82be-2562308917c1 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:53.566182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 328/659] 10.222.0.73 () {56 vars in 1124 bytes} [Wed Jul 27 17:52:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:53.567791 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cb0db-f3be-4166-8f17-1c35d6556692 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.568144 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cb0db-f3be-4166-8f17-1c35d6556692 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.568491 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cb0db-f3be-4166-8f17-1c35d6556692 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.569943 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 329/660] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:53.571709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cb0db-f3be-4166-8f17-1c35d6556692 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:53.593646 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e6775-fc43-4e15-bf80-ece9df446bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:53.594293 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6775-fc43-4e15-bf80-ece9df446bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.594615 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6775-fc43-4e15-bf80-ece9df446bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.594914 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6775-fc43-4e15-bf80-ece9df446bf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.602434 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e6775-fc43-4e15-bf80-ece9df446bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:53.603888 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e6775-fc43-4e15-bf80-ece9df446bf2 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-eb6e6775-fc43-4e15-bf80-ece9df446bf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:53.618841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:53.619832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:53.620738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:53.620738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:53.620738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:53.620738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:53.620738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:53.620738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:53.620738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:53.620738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:53.628688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 332/661] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:53.628688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908100f-d4fd-45eb-a2c7-0dddfd198632 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.628688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908100f-d4fd-45eb-a2c7-0dddfd198632 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.628688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908100f-d4fd-45eb-a2c7-0dddfd198632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.646909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-3908100f-d4fd-45eb-a2c7-0dddfd198632 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:53.648115 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-3908100f-d4fd-45eb-a2c7-0dddfd198632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:53.689154 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cb0db-f3be-4166-8f17-1c35d6556692 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:53.706759 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:53.718780 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 333/662] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:53.720319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908100f-d4fd-45eb-a2c7-0dddfd198632 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:53.730272 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd71acb-17d9-44a7-ba79-02d559d16eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:53.730947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd71acb-17d9-44a7-ba79-02d559d16eba None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.731228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd71acb-17d9-44a7-ba79-02d559d16eba None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.731503 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd71acb-17d9-44a7-ba79-02d559d16eba None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.732306 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd71acb-17d9-44a7-ba79-02d559d16eba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:53.732613 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd71acb-17d9-44a7-ba79-02d559d16eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:53.733981 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd71acb-17d9-44a7-ba79-02d559d16eba None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:53.740986 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 330/663] 10.222.0.73 () {56 vars in 1124 bytes} [Wed Jul 27 17:52:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:53.746064 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd71acb-17d9-44a7-ba79-02d559d16eba None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:53.775115 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:53.886568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd71acb-17d9-44a7-ba79-02d559d16eba None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:53.898194 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908100f-d4fd-45eb-a2c7-0dddfd198632 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:53.930746 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256ef72-ece5-4ead-b265-17a3439c5f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:53.932359 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256ef72-ece5-4ead-b265-17a3439c5f9e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.932791 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256ef72-ece5-4ead-b265-17a3439c5f9e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.933210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256ef72-ece5-4ead-b265-17a3439c5f9e None admin] PATH_INFO: `/v3/services/network` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.934256 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256ef72-ece5-4ead-b265-17a3439c5f9e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:53.936258 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256ef72-ece5-4ead-b265-17a3439c5f9e None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:53.944445 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0bdb-f663-490a-ba7f-a0579d7120db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:53.945076 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0bdb-f663-490a-ba7f-a0579d7120db None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:53.945357 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0bdb-f663-490a-ba7f-a0579d7120db None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:53.945631 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0bdb-f663-490a-ba7f-a0579d7120db None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:53.946386 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc0bdb-f663-490a-ba7f-a0579d7120db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:53.946736 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc0bdb-f663-490a-ba7f-a0579d7120db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:53.948163 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc0bdb-f663-490a-ba7f-a0579d7120db None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-2256ef72-ece5-4ead-b265-17a3439c5f9e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:53.948517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:53.949696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 17:52:53.951736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:53.953143 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 331/664] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:53 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:53.959523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256ef72-ece5-4ead-b265-17a3439c5f9e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:53.970794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 334/665] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:53.972392 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0bdb-f663-490a-ba7f-a0579d7120db None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:54.010911 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:54.073432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:54.077285 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256ef72-ece5-4ead-b265-17a3439c5f9e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:54.085565 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0bdb-f663-490a-ba7f-a0579d7120db None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:54.115232 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1134c-68d5-4228-9aec-9573cdfff643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:54.115794 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1134c-68d5-4228-9aec-9573cdfff643 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:54.116080 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1134c-68d5-4228-9aec-9573cdfff643 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:54.116357 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1134c-68d5-4228-9aec-9573cdfff643 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:54.117475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1134c-68d5-4228-9aec-9573cdfff643 None admin] RBAC: Adding query filter params (name=network) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:54.117475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1134c-68d5-4228-9aec-9573cdfff643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:54.118854 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1134c-68d5-4228-9aec-9573cdfff643 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:54.128683 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 332/666] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:52:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:54.128870 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b37301-178d-4c33-a478-cb34045587e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:54.128870 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b37301-178d-4c33-a478-cb34045587e3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:54.128870 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b37301-178d-4c33-a478-cb34045587e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:54.128870 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b37301-178d-4c33-a478-cb34045587e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:54.129166 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b37301-178d-4c33-a478-cb34045587e3 None admin] RBAC: Adding query filter params (role.id=d6d0c56d1054455c813546a2c761a7d0, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=de6300c387da4594bca473cd708b79f9) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:54.129782 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1134c-68d5-4228-9aec-9573cdfff643 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:54.130187 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b37301-178d-4c33-a478-cb34045587e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:54.132058 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b37301-178d-4c33-a478-cb34045587e3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:54.138832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 335/667] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:52:53 2022] GET /identity/v3/role_assignments?user.id=de6300c387da4594bca473cd708b79f9&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:54.250467 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1134c-68d5-4228-9aec-9573cdfff643 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:54.261449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:54.291179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fffdf-e2ae-42b3-9234-e6052ab798e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:54.291876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fffdf-e2ae-42b3-9234-e6052ab798e7 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:54.292161 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fffdf-e2ae-42b3-9234-e6052ab798e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:54.292443 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fffdf-e2ae-42b3-9234-e6052ab798e7 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:54.293242 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fffdf-e2ae-42b3-9234-e6052ab798e7 None admin] RBAC: Adding query filter params (type=network) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:54.293560 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fffdf-e2ae-42b3-9234-e6052ab798e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:54.295018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fffdf-e2ae-42b3-9234-e6052ab798e7 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:54.301387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 333/668] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:52:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:55.256234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdd95b-13f3-45fb-bee4-c6286eb0ad81 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:55.256763 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdd95b-13f3-45fb-bee4-c6286eb0ad81 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:55.256763 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdd95b-13f3-45fb-bee4-c6286eb0ad81 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:55.258347 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 336/669] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:55.263640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e5a3f-d76d-4228-b59e-b3696486599d None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:55.264060 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e5a3f-d76d-4228-b59e-b3696486599d None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:55.264199 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e5a3f-d76d-4228-b59e-b3696486599d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:55.283724 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-a18e5a3f-d76d-4228-b59e-b3696486599d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:55.284931 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-a18e5a3f-d76d-4228-b59e-b3696486599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:55.359644 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 334/670] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:55.384869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdd95b-13f3-45fb-bee4-c6286eb0ad81 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:55.495984 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdd95b-13f3-45fb-bee4-c6286eb0ad81 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:55.532490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb44b8-80a3-472a-934a-90045b9730f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:55.533573 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb44b8-80a3-472a-934a-90045b9730f8 None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:55.533921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb44b8-80a3-472a-934a-90045b9730f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:55.534130 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb44b8-80a3-472a-934a-90045b9730f8 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:55.534878 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb44b8-80a3-472a-934a-90045b9730f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:55.536247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb44b8-80a3-472a-934a-90045b9730f8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:55.553978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 337/671] 10.222.0.73 () {60 vars in 1141 bytes} [Wed Jul 27 17:52:55 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:52:56.132235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0182-36c3-4d61-9913-4963825e9a14 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:56.132615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0182-36c3-4d61-9913-4963825e9a14 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:56.132793 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0182-36c3-4d61-9913-4963825e9a14 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:56.134399 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 335/672] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:56.139795 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c4962-3c7a-4ea0-9e5c-b0804e17fcd8 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:56.140096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c4962-3c7a-4ea0-9e5c-b0804e17fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:56.140381 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c4962-3c7a-4ea0-9e5c-b0804e17fcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:56.160162 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-956c4962-3c7a-4ea0-9e5c-b0804e17fcd8 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:56.161374 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-956c4962-3c7a-4ea0-9e5c-b0804e17fcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:56.171264 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:56.245075 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 338/673] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:56 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:56.269439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c0182-36c3-4d61-9913-4963825e9a14 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:56.381305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c0182-36c3-4d61-9913-4963825e9a14 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:56.393831 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:56.418821 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05eea5-57a9-4324-b46c-2a6615ec5d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:56.419446 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05eea5-57a9-4324-b46c-2a6615ec5d5c None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:56.419727 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05eea5-57a9-4324-b46c-2a6615ec5d5c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:56.420006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05eea5-57a9-4324-b46c-2a6615ec5d5c None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:56.420718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05eea5-57a9-4324-b46c-2a6615ec5d5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:56.422091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05eea5-57a9-4324-b46c-2a6615ec5d5c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:56.429195 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d282416-defe-4a7b-a4b3-3fbf90c3f236 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:56.429687 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d282416-defe-4a7b-a4b3-3fbf90c3f236 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:56.429777 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d282416-defe-4a7b-a4b3-3fbf90c3f236 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:56.431805 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 339/674] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:56.440231 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5f3f4-0732-4475-9fa7-6463289fb666 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:56.440700 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5f3f4-0732-4475-9fa7-6463289fb666 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:56.441389 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5f3f4-0732-4475-9fa7-6463289fb666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:56.444916 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 336/675] 10.222.0.73 () {60 vars in 1141 bytes} [Wed Jul 27 17:52:56 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:52:56.462415 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-3be5f3f4-0732-4475-9fa7-6463289fb666 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:56.463964 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-3be5f3f4-0732-4475-9fa7-6463289fb666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:56.555398 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 340/676] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:56 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:56.579440 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05eea5-57a9-4324-b46c-2a6615ec5d5c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:56.639961 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32499290-6c4a-40d1-ba4f-2a02e1509df7 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:56.640286 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32499290-6c4a-40d1-ba4f-2a02e1509df7 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:56.640539 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32499290-6c4a-40d1-ba4f-2a02e1509df7 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:56.642145 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 341/677] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:56.647961 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350be9-6e76-4a2b-b83b-3ed3331a24a3 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:56.648197 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350be9-6e76-4a2b-b83b-3ed3331a24a3 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:56.648458 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350be9-6e76-4a2b-b83b-3ed3331a24a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:56.670372 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-0f350be9-6e76-4a2b-b83b-3ed3331a24a3 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:56.671815 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-0f350be9-6e76-4a2b-b83b-3ed3331a24a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:56.696507 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05eea5-57a9-4324-b46c-2a6615ec5d5c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:56.742343 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa9284-8aad-4992-8a9d-758fb366f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:56.743038 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa9284-8aad-4992-8a9d-758fb366f18a None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:56.743315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa9284-8aad-4992-8a9d-758fb366f18a None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:56.743590 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa9284-8aad-4992-8a9d-758fb366f18a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:56.750096 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:56.764996 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 342/678] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:56 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 17:52:56.765923 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa9284-8aad-4992-8a9d-758fb366f18a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-e5aa9284-8aad-4992-8a9d-758fb366f18a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:52:56.772087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:56.773150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:56.774361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 337/679] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:52:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:56.780665 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f350be9-6e76-4a2b-b83b-3ed3331a24a3 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:56.797140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa9284-8aad-4992-8a9d-758fb366f18a None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:56.827007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:56.910385 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa9284-8aad-4992-8a9d-758fb366f18a None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:56.915600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f350be9-6e76-4a2b-b83b-3ed3331a24a3 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:56.957411 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b0651-09ea-4cb2-9dfc-b98890201113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:56.958454 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0651-09ea-4cb2-9dfc-b98890201113 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:56.959039 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0651-09ea-4cb2-9dfc-b98890201113 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:56.959663 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0651-09ea-4cb2-9dfc-b98890201113 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:56.960746 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b0651-09ea-4cb2-9dfc-b98890201113 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:56.961090 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd73a2-40fb-4de5-bb87-1b613f17dd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:56.961768 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd73a2-40fb-4de5-bb87-1b613f17dd1c None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:56.962046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd73a2-40fb-4de5-bb87-1b613f17dd1c None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:56.962322 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd73a2-40fb-4de5-bb87-1b613f17dd1c None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:56.963217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd73a2-40fb-4de5-bb87-1b613f17dd1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:56.963527 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd73a2-40fb-4de5-bb87-1b613f17dd1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:56.965061 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b0651-09ea-4cb2-9dfc-b98890201113 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:56.965243 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd73a2-40fb-4de5-bb87-1b613f17dd1c None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:56.975577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 343/680] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:52:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:56.981137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd73a2-40fb-4de5-bb87-1b613f17dd1c None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:56.991901 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 338/681] 10.222.0.73 () {60 vars in 1141 bytes} [Wed Jul 27 17:52:56 2022] POST /identity/v3/services => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 17:52:57.059532 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:57.109656 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd73a2-40fb-4de5-bb87-1b613f17dd1c None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:57.158748 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54f91e-9013-4b23-8710-d646533a38ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:57.159520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54f91e-9013-4b23-8710-d646533a38ee None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:57.159806 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54f91e-9013-4b23-8710-d646533a38ee None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:57.160086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54f91e-9013-4b23-8710-d646533a38ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:57.172635 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54f91e-9013-4b23-8710-d646533a38ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:57.174103 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54f91e-9013-4b23-8710-d646533a38ee None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-bb54f91e-9013-4b23-8710-d646533a38ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:57.190876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:57.191821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:57.192743 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:57.192743 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:57.192743 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:57.192743 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:57.192743 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 344/682] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:57.198164 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b0651-09ea-4cb2-9dfc-b98890201113 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:57.288868 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:57.310531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b0651-09ea-4cb2-9dfc-b98890201113 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:57.351694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b535b-fa62-4c81-abc5-2e8c55c0ee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:57.352322 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b535b-fa62-4c81-abc5-2e8c55c0ee9a None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:57.352599 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b535b-fa62-4c81-abc5-2e8c55c0ee9a None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:57.352875 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b535b-fa62-4c81-abc5-2e8c55c0ee9a None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:57.353676 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b535b-fa62-4c81-abc5-2e8c55c0ee9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:57.353980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b535b-fa62-4c81-abc5-2e8c55c0ee9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:57.355375 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b535b-fa62-4c81-abc5-2e8c55c0ee9a None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:57.369220 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 339/683] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:57.374774 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54f91e-9013-4b23-8710-d646533a38ee None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:57.480108 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54f91e-9013-4b23-8710-d646533a38ee None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:57.487808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:57.519896 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7fd82-1223-478a-829d-781670dbb16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:57.520931 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7fd82-1223-478a-829d-781670dbb16f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:57.521423 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7fd82-1223-478a-829d-781670dbb16f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:57.521905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7fd82-1223-478a-829d-781670dbb16f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:57.530391 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7fd82-1223-478a-829d-781670dbb16f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:57.532135 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7fd82-1223-478a-829d-781670dbb16f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-85c7fd82-1223-478a-829d-781670dbb16f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:52:57.544296 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:57.545295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:57.546270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:57.546270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:57.546270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:52:57.546270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:52:57.546270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:52:57.546270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:52:57.546270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:52:57.546270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:52:57.546270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:52:57.546270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:57.549411 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 345/684] 10.222.0.73 () {56 vars in 1093 bytes} [Wed Jul 27 17:52:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:52:57.555080 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b535b-fa62-4c81-abc5-2e8c55c0ee9a None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:57.670244 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b535b-fa62-4c81-abc5-2e8c55c0ee9a None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:57.707958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349d7c1-22fa-46aa-81ad-09a3061d9462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:57.708640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349d7c1-22fa-46aa-81ad-09a3061d9462 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:57.708985 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349d7c1-22fa-46aa-81ad-09a3061d9462 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:57.709275 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349d7c1-22fa-46aa-81ad-09a3061d9462 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:57.710116 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349d7c1-22fa-46aa-81ad-09a3061d9462 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:57.710422 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349d7c1-22fa-46aa-81ad-09a3061d9462 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:57.711877 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349d7c1-22fa-46aa-81ad-09a3061d9462 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:57.730462 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:57.730655 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 340/685] 10.222.0.73 () {56 vars in 1133 bytes} [Wed Jul 27 17:52:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:57.737838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7fd82-1223-478a-829d-781670dbb16f None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:57.858214 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7fd82-1223-478a-829d-781670dbb16f None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:57.894007 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d733a5c-bf0c-40e7-a811-fd70cf37b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:57.894681 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d733a5c-bf0c-40e7-a811-fd70cf37b9ad None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:57.894965 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d733a5c-bf0c-40e7-a811-fd70cf37b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:57.895274 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d733a5c-bf0c-40e7-a811-fd70cf37b9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:57.906541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d733a5c-bf0c-40e7-a811-fd70cf37b9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:57.908550 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d733a5c-bf0c-40e7-a811-fd70cf37b9ad None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-4d733a5c-bf0c-40e7-a811-fd70cf37b9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:52:57.923071 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:57.924107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:57.925008 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:52:57.925008 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:52:57.925008 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:52:57.925008 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:57.928881 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 346/686] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:57.931593 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349d7c1-22fa-46aa-81ad-09a3061d9462 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:57.964998 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be97c-1d54-45f0-b347-92999d4b0abe None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:57.965321 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be97c-1d54-45f0-b347-92999d4b0abe None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:57.965552 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be97c-1d54-45f0-b347-92999d4b0abe None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:57.967254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 347/687] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:57.972710 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc212aa-7ee5-4d1c-8410-5b697f355df9 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:57.972999 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc212aa-7ee5-4d1c-8410-5b697f355df9 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:57.973278 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc212aa-7ee5-4d1c-8410-5b697f355df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:57.999770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-2dc212aa-7ee5-4d1c-8410-5b697f355df9 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:58.001119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-2dc212aa-7ee5-4d1c-8410-5b697f355df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:58.020334 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:58.041231 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349d7c1-22fa-46aa-81ad-09a3061d9462 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:58.077039 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdfd25-c877-4717-a223-fdc136288a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:58.077894 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdfd25-c877-4717-a223-fdc136288a0c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:58.078322 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdfd25-c877-4717-a223-fdc136288a0c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:58.078771 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdfd25-c877-4717-a223-fdc136288a0c None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:58.079632 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdfd25-c877-4717-a223-fdc136288a0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:58.080899 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdfd25-c877-4717-a223-fdc136288a0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:58.082594 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdfd25-c877-4717-a223-fdc136288a0c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:58.084245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 348/688] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 17:52:58.094812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 341/689] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:58.100721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc212aa-7ee5-4d1c-8410-5b697f355df9 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:58.106930 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdfd25-c877-4717-a223-fdc136288a0c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:58.187371 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:58.223897 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc212aa-7ee5-4d1c-8410-5b697f355df9 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:58.246006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdfd25-c877-4717-a223-fdc136288a0c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:58.263055 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce228e-a6f5-4b23-9b78-4a0bf69742bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:58.263745 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce228e-a6f5-4b23-9b78-4a0bf69742bd None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:58.264102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce228e-a6f5-4b23-9b78-4a0bf69742bd None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:58.264449 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce228e-a6f5-4b23-9b78-4a0bf69742bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:58.273900 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce228e-a6f5-4b23-9b78-4a0bf69742bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:58.275525 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce228e-a6f5-4b23-9b78-4a0bf69742bd None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-e8ce228e-a6f5-4b23-9b78-4a0bf69742bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:52:58.289670 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:58.290703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:58.291621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:52:58.291621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:52:58.291621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:52:58.291621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:52:58.291621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:52:58.291621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:52:58.291621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:52:58.291621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:52:58.295709 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 349/690] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:58.296277 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a57f9-c1ef-476e-97bd-3d68b0358312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:58.296745 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce228e-a6f5-4b23-9b78-4a0bf69742bd None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:58.297609 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a57f9-c1ef-476e-97bd-3d68b0358312 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:58.298109 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a57f9-c1ef-476e-97bd-3d68b0358312 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:58.298623 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a57f9-c1ef-476e-97bd-3d68b0358312 None admin] PATH_INFO: `/v3/services/image` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:58.300728 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a57f9-c1ef-476e-97bd-3d68b0358312 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:58.303126 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a57f9-c1ef-476e-97bd-3d68b0358312 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-fd5a57f9-c1ef-476e-97bd-3d68b0358312 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:58.316173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:58.317254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:58.318253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 342/691] 10.222.0.73 () {56 vars in 1105 bytes} [Wed Jul 27 17:52:58 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:58.320014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:58.331943 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a57f9-c1ef-476e-97bd-3d68b0358312 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:58.418004 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce228e-a6f5-4b23-9b78-4a0bf69742bd None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:58.457591 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5db863-54df-4051-9ebf-f278b0f3af21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:58.458554 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db863-54df-4051-9ebf-f278b0f3af21 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:58.459126 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db863-54df-4051-9ebf-f278b0f3af21 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:58.459577 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db863-54df-4051-9ebf-f278b0f3af21 None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:58.460502 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5db863-54df-4051-9ebf-f278b0f3af21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:58.460983 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5db863-54df-4051-9ebf-f278b0f3af21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:58.462619 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5db863-54df-4051-9ebf-f278b0f3af21 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:58.475951 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 350/692] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:58.477397 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a57f9-c1ef-476e-97bd-3d68b0358312 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:58.482648 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5db863-54df-4051-9ebf-f278b0f3af21 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:58.509299 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:58.522137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794379c-4549-4c56-9a4e-7ffcff08c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:58.522744 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794379c-4549-4c56-9a4e-7ffcff08c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:58.523029 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794379c-4549-4c56-9a4e-7ffcff08c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:58.523309 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794379c-4549-4c56-9a4e-7ffcff08c7e2 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:58.523999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794379c-4549-4c56-9a4e-7ffcff08c7e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:58.524308 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794379c-4549-4c56-9a4e-7ffcff08c7e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:58.525698 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794379c-4549-4c56-9a4e-7ffcff08c7e2 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:58.536848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 343/693] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:58.537879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794379c-4549-4c56-9a4e-7ffcff08c7e2 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:58.570693 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:58.620437 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5db863-54df-4051-9ebf-f278b0f3af21 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:58.659915 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794379c-4549-4c56-9a4e-7ffcff08c7e2 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:58.668738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ef493-7e92-4d98-bd5e-42b332ac9706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:58.669721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ef493-7e92-4d98-bd5e-42b332ac9706 None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:58.670210 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ef493-7e92-4d98-bd5e-42b332ac9706 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:58.670721 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ef493-7e92-4d98-bd5e-42b332ac9706 None admin] PATH_INFO: `/v3/projects/bcf65bac3a154c95b119204e594db593/users/de6300c387da4594bca473cd708b79f9/roles/d6d0c56d1054455c813546a2c761a7d0` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:58.672951 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ef493-7e92-4d98-bd5e-42b332ac9706 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf65bac3a154c95b119204e594db593, user_id=de6300c387da4594bca473cd708b79f9, role_id=d6d0c56d1054455c813546a2c761a7d0)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:58.675052 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ef493-7e92-4d98-bd5e-42b332ac9706 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:58.691786 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 351/694] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:52:58 2022] PUT /identity/v3/projects/bcf65bac3a154c95b119204e594db593/users/de6300c387da4594bca473cd708b79f9/roles/d6d0c56d1054455c813546a2c761a7d0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:52:58.710204 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ec2cd-38f6-4473-9c2c-246c2163f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:58.710900 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ec2cd-38f6-4473-9c2c-246c2163f5d5 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:58.711184 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ec2cd-38f6-4473-9c2c-246c2163f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:58.711460 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ec2cd-38f6-4473-9c2c-246c2163f5d5 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:58.712148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ec2cd-38f6-4473-9c2c-246c2163f5d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:58.712459 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ec2cd-38f6-4473-9c2c-246c2163f5d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:58.713831 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ec2cd-38f6-4473-9c2c-246c2163f5d5 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:58.723436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 344/695] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:52:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:58.729459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ef493-7e92-4d98-bd5e-42b332ac9706 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:58.867038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ef493-7e92-4d98-bd5e-42b332ac9706 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:58.897430 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:58.905911 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9091d9-353d-46b3-ae03-3442f3d0ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:58.908598 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9091d9-353d-46b3-ae03-3442f3d0ba4b None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:58.908961 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9091d9-353d-46b3-ae03-3442f3d0ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:58.909231 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9091d9-353d-46b3-ae03-3442f3d0ba4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:58.909945 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9091d9-353d-46b3-ae03-3442f3d0ba4b None admin] RBAC: Adding query filter params (interface=public, service_id=c728744c455c4fb094d13576f78d8ae3, region_id=RegionOne) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:58.910262 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9091d9-353d-46b3-ae03-3442f3d0ba4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:58.911857 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9091d9-353d-46b3-ae03-3442f3d0ba4b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:58.916925 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aea86a-2770-46b5-8f1e-23eaeb863d6e None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:58.917213 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aea86a-2770-46b5-8f1e-23eaeb863d6e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:58.917986 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aea86a-2770-46b5-8f1e-23eaeb863d6e None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:58.919118 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 345/696] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:52:58.921566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 352/697] 10.222.0.73 () {56 vars in 1251 bytes} [Wed Jul 27 17:52:58 2022] GET /identity/v3/endpoints?service_id=c728744c455c4fb094d13576f78d8ae3&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:58.924964 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a62bd4-3264-4c5d-b335-c2ad22ed277a None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:58.925322 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a62bd4-3264-4c5d-b335-c2ad22ed277a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:58.925610 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a62bd4-3264-4c5d-b335-c2ad22ed277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:58.928394 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9091d9-353d-46b3-ae03-3442f3d0ba4b None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:58.948761 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-b8a62bd4-3264-4c5d-b335-c2ad22ed277a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:58.950095 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-b8a62bd4-3264-4c5d-b335-c2ad22ed277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:59.022058 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:59.051056 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 346/698] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:52:59.055189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9091d9-353d-46b3-ae03-3442f3d0ba4b None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:59.074083 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a62bd4-3264-4c5d-b335-c2ad22ed277a None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:59.098253 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918bc29-3fab-457c-a6c8-479a5f30af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:59.099379 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918bc29-3fab-457c-a6c8-479a5f30af17 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:59.099941 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918bc29-3fab-457c-a6c8-479a5f30af17 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:59.100646 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918bc29-3fab-457c-a6c8-479a5f30af17 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:59.101738 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918bc29-3fab-457c-a6c8-479a5f30af17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:59.103899 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918bc29-3fab-457c-a6c8-479a5f30af17 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:59.114062 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 353/699] 10.222.0.73 () {56 vars in 1087 bytes} [Wed Jul 27 17:52:58 2022] GET /identity/v3/services => generated 1002 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 17:52:59.203319 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a62bd4-3264-4c5d-b335-c2ad22ed277a None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:59.244355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af857c-6f30-49aa-aa84-ee0cb1199742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:59.245456 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af857c-6f30-49aa-aa84-ee0cb1199742 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:59.245946 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af857c-6f30-49aa-aa84-ee0cb1199742 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:59.246424 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af857c-6f30-49aa-aa84-ee0cb1199742 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:59.247310 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af857c-6f30-49aa-aa84-ee0cb1199742 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:59.248963 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af857c-6f30-49aa-aa84-ee0cb1199742 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-56af857c-6f30-49aa-aa84-ee0cb1199742 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:59.259780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:59.260792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 17:52:59.261659 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:59.263208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 347/700] 10.222.0.73 () {56 vars in 1129 bytes} [Wed Jul 27 17:52:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:59.269741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918bc29-3fab-457c-a6c8-479a5f30af17 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:59.338331 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:59.390186 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918bc29-3fab-457c-a6c8-479a5f30af17 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:59.426559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dee9b-7fa6-4d84-9fb5-acf97005857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:59.427502 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dee9b-7fa6-4d84-9fb5-acf97005857f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:59.428025 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dee9b-7fa6-4d84-9fb5-acf97005857f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:59.428509 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dee9b-7fa6-4d84-9fb5-acf97005857f None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:59.429417 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dee9b-7fa6-4d84-9fb5-acf97005857f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:59.429904 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dee9b-7fa6-4d84-9fb5-acf97005857f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:59.431511 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dee9b-7fa6-4d84-9fb5-acf97005857f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:59.437118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 354/701] 10.222.0.73 () {56 vars in 1124 bytes} [Wed Jul 27 17:52:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:52:59.443731 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af857c-6f30-49aa-aa84-ee0cb1199742 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:59.488576 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252944f3-0202-4e12-a002-ebee8da4d78d None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:59.489109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252944f3-0202-4e12-a002-ebee8da4d78d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:59.489109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252944f3-0202-4e12-a002-ebee8da4d78d None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:59.490749 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 355/702] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:52:59.495709 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b345993-f73b-40d7-bafb-77b55358d9b6 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:59.495998 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b345993-f73b-40d7-bafb-77b55358d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:59.496280 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b345993-f73b-40d7-bafb-77b55358d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:59.499061 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:59.515737 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-4b345993-f73b-40d7-bafb-77b55358d9b6 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:52:59.516976 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-4b345993-f73b-40d7-bafb-77b55358d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:52:59.564558 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af857c-6f30-49aa-aa84-ee0cb1199742 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:59.603533 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dd217-0b24-4211-8873-9387cd3468ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:59.604096 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dd217-0b24-4211-8873-9387cd3468ab None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:59.604382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dd217-0b24-4211-8873-9387cd3468ab None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:59.604803 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dd217-0b24-4211-8873-9387cd3468ab None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:59.605498 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dd217-0b24-4211-8873-9387cd3468ab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:59.605732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 356/703] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:52:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 17:52:59.614970 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dd217-0b24-4211-8873-9387cd3468ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:59.616437 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dd217-0b24-4211-8873-9387cd3468ab None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:59.622551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 348/704] 10.222.0.73 () {56 vars in 1124 bytes} [Wed Jul 27 17:52:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:59.628835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b345993-f73b-40d7-bafb-77b55358d9b6 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:59.637896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dd217-0b24-4211-8873-9387cd3468ab None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:59.685278 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:59.741287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b345993-f73b-40d7-bafb-77b55358d9b6 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:59.762086 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dd217-0b24-4211-8873-9387cd3468ab None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:59.773896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:59.786320 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8891f53-77ec-43c0-be65-7c140accc91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:59.787337 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891f53-77ec-43c0-be65-7c140accc91c None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:59.787805 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891f53-77ec-43c0-be65-7c140accc91c None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:59.788258 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891f53-77ec-43c0-be65-7c140accc91c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:59.789193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8891f53-77ec-43c0-be65-7c140accc91c None admin] RBAC: Adding query filter params (interface=public, service_id=4dbbe5420f5a4af78ac43e5c6e9cfc09, region_id=RegionOne) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:52:59.789710 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8891f53-77ec-43c0-be65-7c140accc91c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:59.793398 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8891f53-77ec-43c0-be65-7c140accc91c None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:59.799852 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 357/705] 10.222.0.73 () {56 vars in 1251 bytes} [Wed Jul 27 17:52:59 2022] GET /identity/v3/endpoints?service_id=4dbbe5420f5a4af78ac43e5c6e9cfc09&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:52:59.805375 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8891f53-77ec-43c0-be65-7c140accc91c None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:59.807490 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaced6-a37b-4abf-8e32-904afa5256ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:59.808552 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaced6-a37b-4abf-8e32-904afa5256ba None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:59.809848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaced6-a37b-4abf-8e32-904afa5256ba None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:59.810333 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaced6-a37b-4abf-8e32-904afa5256ba None admin] PATH_INFO: `/v3/services/network` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:59.811226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaced6-a37b-4abf-8e32-904afa5256ba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:59.812955 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaced6-a37b-4abf-8e32-904afa5256ba None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-1ddaced6-a37b-4abf-8e32-904afa5256ba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:52:59.825672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:52:59.826856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 17:52:59.827708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:52:59.836866 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 349/706] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:52:59 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:52:59.838442 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaced6-a37b-4abf-8e32-904afa5256ba None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:52:59.919038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8891f53-77ec-43c0-be65-7c140accc91c None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:59.934611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:52:59.961246 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaced6-a37b-4abf-8e32-904afa5256ba None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:52:59.966050 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99e285-ae8a-443b-b6ee-18ddb54e2548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:52:59.966809 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99e285-ae8a-443b-b6ee-18ddb54e2548 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:52:59.967164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99e285-ae8a-443b-b6ee-18ddb54e2548 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:52:59.967543 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99e285-ae8a-443b-b6ee-18ddb54e2548 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:52:59.968280 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99e285-ae8a-443b-b6ee-18ddb54e2548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:52:59.970298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99e285-ae8a-443b-b6ee-18ddb54e2548 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:52:59.979203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 358/707] 10.222.0.73 () {56 vars in 1087 bytes} [Wed Jul 27 17:52:59 2022] GET /identity/v3/services => generated 1002 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 17:53:00.018236 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59055cab-61e0-4df5-abd1-0ebcbab7228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:00.019271 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055cab-61e0-4df5-abd1-0ebcbab7228a None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:00.019690 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055cab-61e0-4df5-abd1-0ebcbab7228a None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:00.020104 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055cab-61e0-4df5-abd1-0ebcbab7228a None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:00.021188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59055cab-61e0-4df5-abd1-0ebcbab7228a None admin] RBAC: Adding query filter params (name=network) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:00.021651 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59055cab-61e0-4df5-abd1-0ebcbab7228a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:00.024041 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59055cab-61e0-4df5-abd1-0ebcbab7228a None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:00.033047 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 350/708] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:52:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:00.044139 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99e285-ae8a-443b-b6ee-18ddb54e2548 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:00.160684 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99e285-ae8a-443b-b6ee-18ddb54e2548 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:00.200181 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd563f4-7ffb-4afb-97b8-57424d6d9824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:00.201160 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd563f4-7ffb-4afb-97b8-57424d6d9824 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:00.201699 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd563f4-7ffb-4afb-97b8-57424d6d9824 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:00.202198 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd563f4-7ffb-4afb-97b8-57424d6d9824 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:00.203139 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd563f4-7ffb-4afb-97b8-57424d6d9824 None admin] RBAC: Adding query filter params (type=network) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:00.203652 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd563f4-7ffb-4afb-97b8-57424d6d9824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:00.205819 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd563f4-7ffb-4afb-97b8-57424d6d9824 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:00.212489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 359/709] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:53:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:00.219293 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59055cab-61e0-4df5-abd1-0ebcbab7228a None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:00.273407 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:00.351589 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59055cab-61e0-4df5-abd1-0ebcbab7228a None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:00.389918 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca92e79-4c52-4a7e-add8-6207755220ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:00.390575 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92e79-4c52-4a7e-add8-6207755220ea None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:00.390857 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92e79-4c52-4a7e-add8-6207755220ea None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:00.391134 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92e79-4c52-4a7e-add8-6207755220ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:00.391889 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca92e79-4c52-4a7e-add8-6207755220ea None admin] RBAC: Adding query filter params (interface=public, service_id=5f54ab38ef8a45f78c529ab7272f77b4, region_id=RegionOne) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:00.392198 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca92e79-4c52-4a7e-add8-6207755220ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:00.394113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca92e79-4c52-4a7e-add8-6207755220ea None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:00.402703 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 351/710] 10.222.0.73 () {56 vars in 1251 bytes} [Wed Jul 27 17:53:00 2022] GET /identity/v3/endpoints?service_id=5f54ab38ef8a45f78c529ab7272f77b4&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:53:00.408915 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd563f4-7ffb-4afb-97b8-57424d6d9824 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:00.456153 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:00.525032 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd563f4-7ffb-4afb-97b8-57424d6d9824 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:00.562652 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd48acf-83f3-40a4-a8df-c685d78b7c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:00.563667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd48acf-83f3-40a4-a8df-c685d78b7c02 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:00.564174 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd48acf-83f3-40a4-a8df-c685d78b7c02 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:00.565372 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd48acf-83f3-40a4-a8df-c685d78b7c02 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:00.566530 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd48acf-83f3-40a4-a8df-c685d78b7c02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:00.568118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd48acf-83f3-40a4-a8df-c685d78b7c02 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:00.574403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 360/711] 10.222.0.73 () {56 vars in 1087 bytes} [Wed Jul 27 17:53:00 2022] GET /identity/v3/services => generated 1002 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 17:53:01.233120 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e339a-9f85-4317-ac4b-c013369b0079 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:01.233641 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e339a-9f85-4317-ac4b-c013369b0079 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:01.233641 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e339a-9f85-4317-ac4b-c013369b0079 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:01.235336 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 352/712] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:01.241207 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a176-33c2-4fed-be47-8c8c98cae2c4 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:01.241777 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a176-33c2-4fed-be47-8c8c98cae2c4 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:01.242272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a176-33c2-4fed-be47-8c8c98cae2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:01.260895 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-8e07a176-33c2-4fed-be47-8c8c98cae2c4 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:01.262421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-8e07a176-33c2-4fed-be47-8c8c98cae2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:01.340220 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 361/713] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:01.365824 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e339a-9f85-4317-ac4b-c013369b0079 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:01.475068 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e339a-9f85-4317-ac4b-c013369b0079 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:01.476909 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:01.504300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4d5cf-5853-4ebc-bbee-a4bd4ee6d32e None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:01.504585 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4d5cf-5853-4ebc-bbee-a4bd4ee6d32e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:01.504783 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4d5cf-5853-4ebc-bbee-a4bd4ee6d32e None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:01.506356 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 362/714] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:01.511631 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9575e-2c83-4b39-b017-05e94b898eba None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:01.511922 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9575e-2c83-4b39-b017-05e94b898eba None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:01.512207 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9575e-2c83-4b39-b017-05e94b898eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:01.514501 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a3056-fc52-43f6-8e8b-7299a58b76bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:01.515500 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a3056-fc52-43f6-8e8b-7299a58b76bf None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:01.516071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a3056-fc52-43f6-8e8b-7299a58b76bf None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:01.516557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a3056-fc52-43f6-8e8b-7299a58b76bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:01.527968 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a3056-fc52-43f6-8e8b-7299a58b76bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:53:01.530723 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-0fe9575e-2c83-4b39-b017-05e94b898eba None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:01.531934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-0fe9575e-2c83-4b39-b017-05e94b898eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-0c5a3056-fc52-43f6-8e8b-7299a58b76bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:53:01.534694 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:01.535673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:53:01.536515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:01.543718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 353/715] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:53:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:01.545131 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a3056-fc52-43f6-8e8b-7299a58b76bf None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:01.562953 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:01.607505 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 363/716] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 17:53:01.636802 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9575e-2c83-4b39-b017-05e94b898eba None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:01.647755 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a3056-fc52-43f6-8e8b-7299a58b76bf None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:01.692055 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2da9c0-adc9-4b50-a564-8a14cb3e167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:01.692837 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2da9c0-adc9-4b50-a564-8a14cb3e167a None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:01.693161 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2da9c0-adc9-4b50-a564-8a14cb3e167a None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:01.693446 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2da9c0-adc9-4b50-a564-8a14cb3e167a None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:01.694225 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2da9c0-adc9-4b50-a564-8a14cb3e167a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:01.694564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2da9c0-adc9-4b50-a564-8a14cb3e167a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:01.696061 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2da9c0-adc9-4b50-a564-8a14cb3e167a None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:01.706567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 354/717] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:53:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:01.711503 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2da9c0-adc9-4b50-a564-8a14cb3e167a None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:01.745548 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:01.780321 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9575e-2c83-4b39-b017-05e94b898eba None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:01.822938 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65f1b-38fe-46c3-9c4c-5a5e1e04f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:01.824079 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65f1b-38fe-46c3-9c4c-5a5e1e04f912 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:01.824678 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65f1b-38fe-46c3-9c4c-5a5e1e04f912 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:01.825185 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65f1b-38fe-46c3-9c4c-5a5e1e04f912 None admin] PATH_INFO: `/v3/services/image` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:01.826054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c65f1b-38fe-46c3-9c4c-5a5e1e04f912 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:01.827800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c65f1b-38fe-46c3-9c4c-5a5e1e04f912 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-80c65f1b-38fe-46c3-9c4c-5a5e1e04f912 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:01.839176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:01.840247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 17:53:01.841109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:01.841969 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2da9c0-adc9-4b50-a564-8a14cb3e167a None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:01.849704 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 364/718] 10.222.0.73 () {56 vars in 1105 bytes} [Wed Jul 27 17:53:01 2022] GET /identity/v3/services/image => generated 86 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:53:01.851125 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65f1b-38fe-46c3-9c4c-5a5e1e04f912 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:01.883834 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca2ffd-fcba-458a-b1ef-b7f1e55e26fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:01.884487 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca2ffd-fcba-458a-b1ef-b7f1e55e26fe None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:01.884767 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca2ffd-fcba-458a-b1ef-b7f1e55e26fe None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:01.885065 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca2ffd-fcba-458a-b1ef-b7f1e55e26fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:01.888076 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:01.899965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca2ffd-fcba-458a-b1ef-b7f1e55e26fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:01.901427 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca2ffd-fcba-458a-b1ef-b7f1e55e26fe None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-d8ca2ffd-fcba-458a-b1ef-b7f1e55e26fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:53:01.920742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:01.921736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:01.922681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:53:01.922681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:53:01.922681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:53:01.922681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:01.924938 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 355/719] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:53:01.931124 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca2ffd-fcba-458a-b1ef-b7f1e55e26fe None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:01.978883 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65f1b-38fe-46c3-9c4c-5a5e1e04f912 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:02.017131 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7977f-f502-4da9-9690-b6452ef83a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:02.018719 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7977f-f502-4da9-9690-b6452ef83a91 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:02.019351 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7977f-f502-4da9-9690-b6452ef83a91 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:02.019872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7977f-f502-4da9-9690-b6452ef83a91 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:02.020767 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7977f-f502-4da9-9690-b6452ef83a91 None admin] RBAC: Adding query filter params (name=image) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:02.021283 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7977f-f502-4da9-9690-b6452ef83a91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:02.022886 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7977f-f502-4da9-9690-b6452ef83a91 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:02.027925 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:02.034632 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 365/720] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:53:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:02.036004 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7977f-f502-4da9-9690-b6452ef83a91 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:02.053795 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca2ffd-fcba-458a-b1ef-b7f1e55e26fe None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:02.089222 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b8b1b-6464-4b90-80af-6f8531a5074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:02.089850 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8b1b-6464-4b90-80af-6f8531a5074d None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:02.090167 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8b1b-6464-4b90-80af-6f8531a5074d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:02.090389 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8b1b-6464-4b90-80af-6f8531a5074d None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:02.091114 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b8b1b-6464-4b90-80af-6f8531a5074d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:02.091419 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b8b1b-6464-4b90-80af-6f8531a5074d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:02.092773 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b8b1b-6464-4b90-80af-6f8531a5074d None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:02.109379 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 356/721] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:53:02.110677 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b8b1b-6464-4b90-80af-6f8531a5074d None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:02.142327 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:02.151436 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7977f-f502-4da9-9690-b6452ef83a91 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:02.188692 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e3b38-1a29-44dd-9dc0-6817d79cd80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:02.189732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e3b38-1a29-44dd-9dc0-6817d79cd80d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:02.190258 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e3b38-1a29-44dd-9dc0-6817d79cd80d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:02.190869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e3b38-1a29-44dd-9dc0-6817d79cd80d None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:02.191776 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e3b38-1a29-44dd-9dc0-6817d79cd80d None admin] RBAC: Adding query filter params (type=image) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:02.192292 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e3b38-1a29-44dd-9dc0-6817d79cd80d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:02.194055 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e3b38-1a29-44dd-9dc0-6817d79cd80d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:02.199630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 366/722] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:53:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:02.207504 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e3b38-1a29-44dd-9dc0-6817d79cd80d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:02.224669 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b8b1b-6464-4b90-80af-6f8531a5074d None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:02.267350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623ad7f-f33c-4176-ba50-b452c80aba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:02.268207 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623ad7f-f33c-4176-ba50-b452c80aba4e None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:02.268389 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623ad7f-f33c-4176-ba50-b452c80aba4e None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:02.268768 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623ad7f-f33c-4176-ba50-b452c80aba4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:02.271839 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:02.278251 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623ad7f-f33c-4176-ba50-b452c80aba4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:02.280701 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623ad7f-f33c-4176-ba50-b452c80aba4e None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-b623ad7f-f33c-4176-ba50-b452c80aba4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:53:02.294489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:02.295554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:02.296524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:02.296524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:02.296524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:53:02.296524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:53:02.296524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:53:02.296524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:53:02.296524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:53:02.296524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:53:02.296524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 17:53:02.296524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:02.300638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 357/723] 10.222.0.73 () {56 vars in 1093 bytes} [Wed Jul 27 17:53:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:02.302222 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623ad7f-f33c-4176-ba50-b452c80aba4e None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:02.340328 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e3b38-1a29-44dd-9dc0-6817d79cd80d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:02.380130 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fd2d1-eba1-4e51-8eb5-3c113f97f14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:02.381156 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd2d1-eba1-4e51-8eb5-3c113f97f14a None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:02.381653 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd2d1-eba1-4e51-8eb5-3c113f97f14a None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:02.382136 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd2d1-eba1-4e51-8eb5-3c113f97f14a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:02.383275 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fd2d1-eba1-4e51-8eb5-3c113f97f14a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:02.384895 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fd2d1-eba1-4e51-8eb5-3c113f97f14a None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:02.411358 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 367/724] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 17:53:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:53:02.414597 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623ad7f-f33c-4176-ba50-b452c80aba4e None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:02.446163 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438be3f-ea25-4876-adad-e5fbd133297a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:02.446499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438be3f-ea25-4876-adad-e5fbd133297a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:02.446801 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438be3f-ea25-4876-adad-e5fbd133297a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:02.448503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 368/725] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:53:02.454057 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf47e-5467-4461-9df4-0c76647082cb None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:02.454368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf47e-5467-4461-9df4-0c76647082cb None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:02.454683 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf47e-5467-4461-9df4-0c76647082cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:02.467387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b160dbf-7f6b-4255-97c6-c30c96df8863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:02.468412 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160dbf-7f6b-4255-97c6-c30c96df8863 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:02.468903 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160dbf-7f6b-4255-97c6-c30c96df8863 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:02.470103 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160dbf-7f6b-4255-97c6-c30c96df8863 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:02.472187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b160dbf-7f6b-4255-97c6-c30c96df8863 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:02.472757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b160dbf-7f6b-4255-97c6-c30c96df8863 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:02.474660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b160dbf-7f6b-4255-97c6-c30c96df8863 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:02.475880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-b8faf47e-5467-4461-9df4-0c76647082cb None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:02.477245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-b8faf47e-5467-4461-9df4-0c76647082cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:02.490409 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:02.503656 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 358/726] 10.222.0.73 () {56 vars in 1133 bytes} [Wed Jul 27 17:53:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:53:02.508895 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b160dbf-7f6b-4255-97c6-c30c96df8863 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:02.573728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 369/727] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:02 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 17:53:02.580586 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:02.592346 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faf47e-5467-4461-9df4-0c76647082cb None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:02.664370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b160dbf-7f6b-4255-97c6-c30c96df8863 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:02.710699 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0e3a1-333f-4fb2-b599-0aa6b5dd8824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:02.711520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0e3a1-333f-4fb2-b599-0aa6b5dd8824 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:02.711891 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0e3a1-333f-4fb2-b599-0aa6b5dd8824 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:02.712261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0e3a1-333f-4fb2-b599-0aa6b5dd8824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:02.735932 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faf47e-5467-4461-9df4-0c76647082cb None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:02.783989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e185a7-c560-4eb6-9a28-1da665409307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:02.785181 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e185a7-c560-4eb6-9a28-1da665409307 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:02.785474 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e185a7-c560-4eb6-9a28-1da665409307 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:02.786062 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e185a7-c560-4eb6-9a28-1da665409307 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:02.787193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e185a7-c560-4eb6-9a28-1da665409307 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:02.788910 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e185a7-c560-4eb6-9a28-1da665409307 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:02.794803 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0e3a1-333f-4fb2-b599-0aa6b5dd8824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:02.796663 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0e3a1-333f-4fb2-b599-0aa6b5dd8824 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-65e185a7-c560-4eb6-9a28-1da665409307 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:02.802018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:02.803086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:02.803975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 370/728] 10.222.0.73 () {56 vars in 1129 bytes} [Wed Jul 27 17:53:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:53:02.811474 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e185a7-c560-4eb6-9a28-1da665409307 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:02.839016 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:02.865060 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:02.936542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 359/729] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:53:02 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 17:53:02.942621 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0e3a1-333f-4fb2-b599-0aa6b5dd8824 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:02.950605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e185a7-c560-4eb6-9a28-1da665409307 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:02.990209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92df03-07ec-4e25-a049-1dc4e556aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:02.990880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92df03-07ec-4e25-a049-1dc4e556aeae None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:02.991162 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92df03-07ec-4e25-a049-1dc4e556aeae None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:02.991434 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92df03-07ec-4e25-a049-1dc4e556aeae None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:02.992111 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92df03-07ec-4e25-a049-1dc4e556aeae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:02.992416 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92df03-07ec-4e25-a049-1dc4e556aeae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:02.994279 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92df03-07ec-4e25-a049-1dc4e556aeae None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:03.000273 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 371/730] 10.222.0.73 () {56 vars in 1124 bytes} [Wed Jul 27 17:53:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:53:03.001480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19611-1fd4-425f-b3eb-9334a527b9f7 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:03.001770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19611-1fd4-425f-b3eb-9334a527b9f7 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:03.002602 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19611-1fd4-425f-b3eb-9334a527b9f7 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:03.004148 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 372/731] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:03.009266 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a19611-1fd4-425f-b3eb-9334a527b9f7 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:03.069820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0e3a1-333f-4fb2-b599-0aa6b5dd8824 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:03.088151 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:03.106305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6c19f-5496-409f-9585-fdd98a24a4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:03.106899 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6c19f-5496-409f-9585-fdd98a24a4c9 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:03.107181 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6c19f-5496-409f-9585-fdd98a24a4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:03.107454 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6c19f-5496-409f-9585-fdd98a24a4c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:03.117886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6c19f-5496-409f-9585-fdd98a24a4c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:03.119380 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6c19f-5496-409f-9585-fdd98a24a4c9 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:03.125729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a19611-1fd4-425f-b3eb-9334a527b9f7 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-25e6c19f-5496-409f-9585-fdd98a24a4c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:53:03.135392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:03.141410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:03.143414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:53:03.143414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:53:03.143414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:53:03.143414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:03.143414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 360/732] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:03.143414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13cb92-c12c-4f76-8c20-1f309ddcfc5a None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:03.143414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13cb92-c12c-4f76-8c20-1f309ddcfc5a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:03.143414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13cb92-c12c-4f76-8c20-1f309ddcfc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:03.145670 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:03.160326 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-5f13cb92-c12c-4f76-8c20-1f309ddcfc5a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:03.161591 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-5f13cb92-c12c-4f76-8c20-1f309ddcfc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:03.172054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23475dc2-5b1f-4959-9418-393d55081e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:03.172685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475dc2-5b1f-4959-9418-393d55081e23 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:03.173292 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475dc2-5b1f-4959-9418-393d55081e23 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:03.173578 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475dc2-5b1f-4959-9418-393d55081e23 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:03.174659 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23475dc2-5b1f-4959-9418-393d55081e23 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:03.175020 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23475dc2-5b1f-4959-9418-393d55081e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:03.176398 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23475dc2-5b1f-4959-9418-393d55081e23 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:03.181493 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 373/733] 10.222.0.73 () {56 vars in 1124 bytes} [Wed Jul 27 17:53:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:53:03.182089 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23475dc2-5b1f-4959-9418-393d55081e23 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:03.238249 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 361/734] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:03 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:03.239011 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13cb92-c12c-4f76-8c20-1f309ddcfc5a None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:03.302341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23475dc2-5b1f-4959-9418-393d55081e23 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:03.341569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f9ffa-a438-40c1-9375-bbbcb1667b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:03.342193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f9ffa-a438-40c1-9375-bbbcb1667b98 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:03.342948 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f9ffa-a438-40c1-9375-bbbcb1667b98 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:03.343235 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f9ffa-a438-40c1-9375-bbbcb1667b98 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:03.343928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f9ffa-a438-40c1-9375-bbbcb1667b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:03.344234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f9ffa-a438-40c1-9375-bbbcb1667b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:03.345599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f9ffa-a438-40c1-9375-bbbcb1667b98 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:03.348305 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:03.355744 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13cb92-c12c-4f76-8c20-1f309ddcfc5a None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:03.364911 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 374/735] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:03.364911 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f9ffa-a438-40c1-9375-bbbcb1667b98 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:03.391140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:03.398899 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec34c3c-738c-4cb8-b546-2f1aa184d495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:03.399450 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34c3c-738c-4cb8-b546-2f1aa184d495 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:03.399734 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34c3c-738c-4cb8-b546-2f1aa184d495 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:03.400010 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34c3c-738c-4cb8-b546-2f1aa184d495 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:03.400713 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec34c3c-738c-4cb8-b546-2f1aa184d495 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:03.402333 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec34c3c-738c-4cb8-b546-2f1aa184d495 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:03.425690 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 362/736] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 17:53:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:53:03.426897 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec34c3c-738c-4cb8-b546-2f1aa184d495 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:03.492152 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f9ffa-a438-40c1-9375-bbbcb1667b98 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:03.545816 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1f0bb-8d2a-415b-a093-34a0ac5c30a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:03.547007 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1f0bb-8d2a-415b-a093-34a0ac5c30a5 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:03.547835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1f0bb-8d2a-415b-a093-34a0ac5c30a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:03.548558 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1f0bb-8d2a-415b-a093-34a0ac5c30a5 None admin] PATH_INFO: `/v3/services/network` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:03.549977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1f0bb-8d2a-415b-a093-34a0ac5c30a5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:03.551633 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1f0bb-8d2a-415b-a093-34a0ac5c30a5 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:03.551760 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec34c3c-738c-4cb8-b546-2f1aa184d495 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-13d1f0bb-8d2a-415b-a093-34a0ac5c30a5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:03.564287 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:03.565978 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 17:53:03.566843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:03.568594 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 375/737] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:53:03 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:03.573777 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1f0bb-8d2a-415b-a093-34a0ac5c30a5 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:03.610780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed2b3-cacc-4dda-bf20-a837074dc5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:03.612392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed2b3-cacc-4dda-bf20-a837074dc5a9 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:03.612749 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed2b3-cacc-4dda-bf20-a837074dc5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:03.613089 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed2b3-cacc-4dda-bf20-a837074dc5a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:03.623379 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ed2b3-cacc-4dda-bf20-a837074dc5a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:03.625435 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ed2b3-cacc-4dda-bf20-a837074dc5a9 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-962ed2b3-cacc-4dda-bf20-a837074dc5a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:53:03.641394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:03.642360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:03.644377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:53:03.644377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:53:03.644377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:53:03.644377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:53:03.644377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:53:03.644377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:53:03.644377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:53:03.644377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:03.644377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 363/738] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:03.650965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed2b3-cacc-4dda-bf20-a837074dc5a9 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:03.651576 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:03.713764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1f0bb-8d2a-415b-a093-34a0ac5c30a5 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:03.719806 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:03.763411 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdfd9-7fd0-4e94-a9df-98be43fd9960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:03.764085 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdfd9-7fd0-4e94-a9df-98be43fd9960 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:03.764375 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdfd9-7fd0-4e94-a9df-98be43fd9960 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:03.764741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdfd9-7fd0-4e94-a9df-98be43fd9960 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:03.765523 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cdfd9-7fd0-4e94-a9df-98be43fd9960 None admin] RBAC: Adding query filter params (name=network) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:03.765817 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cdfd9-7fd0-4e94-a9df-98be43fd9960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:03.768276 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cdfd9-7fd0-4e94-a9df-98be43fd9960 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:03.775086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 376/739] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:53:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:53:03.780916 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdfd9-7fd0-4e94-a9df-98be43fd9960 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:03.789732 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed2b3-cacc-4dda-bf20-a837074dc5a9 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:03.829045 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d58c2a-5082-4ac0-a797-939983952dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:03.830262 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d58c2a-5082-4ac0-a797-939983952dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:03.830791 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d58c2a-5082-4ac0-a797-939983952dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:03.831280 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d58c2a-5082-4ac0-a797-939983952dd2 None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:03.832252 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d58c2a-5082-4ac0-a797-939983952dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:03.832634 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d58c2a-5082-4ac0-a797-939983952dd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:03.834180 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d58c2a-5082-4ac0-a797-939983952dd2 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:03.848184 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 364/740] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:53:03.854466 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d58c2a-5082-4ac0-a797-939983952dd2 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:03.920051 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdfd9-7fd0-4e94-a9df-98be43fd9960 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:03.943385 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:03.960555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9946412-0981-45f2-857f-e05c31c39047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:03.961509 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946412-0981-45f2-857f-e05c31c39047 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:03.961997 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946412-0981-45f2-857f-e05c31c39047 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:03.962477 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946412-0981-45f2-857f-e05c31c39047 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:03.963397 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9946412-0981-45f2-857f-e05c31c39047 None admin] RBAC: Adding query filter params (type=network) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:03.963928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9946412-0981-45f2-857f-e05c31c39047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:03.965527 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9946412-0981-45f2-857f-e05c31c39047 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:03.977285 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 377/741] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:53:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:53:03.978462 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9946412-0981-45f2-857f-e05c31c39047 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:03.984335 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d58c2a-5082-4ac0-a797-939983952dd2 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:03.996977 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:04.043667 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c28be-1918-413b-ae9a-80a5b5a9e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:04.044269 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c28be-1918-413b-ae9a-80a5b5a9e802 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:04.044555 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c28be-1918-413b-ae9a-80a5b5a9e802 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:04.044836 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c28be-1918-413b-ae9a-80a5b5a9e802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:04.045650 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c28be-1918-413b-ae9a-80a5b5a9e802 None admin] RBAC: Adding query filter params (role.id=d6d0c56d1054455c813546a2c761a7d0, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=de6300c387da4594bca473cd708b79f9) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:04.045966 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c28be-1918-413b-ae9a-80a5b5a9e802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:04.047682 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c28be-1918-413b-ae9a-80a5b5a9e802 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:04.062824 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 365/742] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:53:03 2022] GET /identity/v3/role_assignments?user.id=de6300c387da4594bca473cd708b79f9&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:04.108544 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9946412-0981-45f2-857f-e05c31c39047 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:04.149586 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318302f4-31f1-4ef9-acfe-1b64cbf4648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:04.150723 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318302f4-31f1-4ef9-acfe-1b64cbf4648d None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:04.151234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318302f4-31f1-4ef9-acfe-1b64cbf4648d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:04.152025 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318302f4-31f1-4ef9-acfe-1b64cbf4648d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:04.152989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318302f4-31f1-4ef9-acfe-1b64cbf4648d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:04.154680 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318302f4-31f1-4ef9-acfe-1b64cbf4648d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:04.180270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 378/743] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 17:53:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:53:04.907154 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04056c11-cee4-4749-b10f-769d50a71191 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:04.907666 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04056c11-cee4-4749-b10f-769d50a71191 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:04.907743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04056c11-cee4-4749-b10f-769d50a71191 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:04.909438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 366/744] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:04.914468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9335-b76c-492f-9993-624e84194a09 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:04.914900 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9335-b76c-492f-9993-624e84194a09 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:04.915162 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9335-b76c-492f-9993-624e84194a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:04.933867 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-f43a9335-b76c-492f-9993-624e84194a09 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:04.935084 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-f43a9335-b76c-492f-9993-624e84194a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:04.971568 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:05.021251 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 379/745] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:04 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:05.049838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04056c11-cee4-4749-b10f-769d50a71191 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:05.158261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04056c11-cee4-4749-b10f-769d50a71191 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:05.194306 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eec831-ddc3-4e7c-8811-ada52e140547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:05.194945 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eec831-ddc3-4e7c-8811-ada52e140547 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:05.195227 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eec831-ddc3-4e7c-8811-ada52e140547 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:05.195502 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eec831-ddc3-4e7c-8811-ada52e140547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:05.239289 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:05.267384 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eec831-ddc3-4e7c-8811-ada52e140547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:05.269149 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eec831-ddc3-4e7c-8811-ada52e140547 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:05.382684 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 367/746] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:53:05 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 17:53:05.387550 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a9335-b76c-492f-9993-624e84194a09 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:05.488349 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a9335-b76c-492f-9993-624e84194a09 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:05.522958 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56321d38-2053-4d20-a8e7-5bdec9a662c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:05.523603 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321d38-2053-4d20-a8e7-5bdec9a662c0 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:05.523881 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321d38-2053-4d20-a8e7-5bdec9a662c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:05.524151 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321d38-2053-4d20-a8e7-5bdec9a662c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:05.535570 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56321d38-2053-4d20-a8e7-5bdec9a662c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:05.537010 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56321d38-2053-4d20-a8e7-5bdec9a662c0 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-56321d38-2053-4d20-a8e7-5bdec9a662c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:53:05.552232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:05.553144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:05.554054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:53:05.554054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:53:05.554054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:53:05.554054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:05.558546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 380/747] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:05.559391 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eec831-ddc3-4e7c-8811-ada52e140547 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:05.630620 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:05.663292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eec831-ddc3-4e7c-8811-ada52e140547 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:05.698498 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2dcc4-4657-4dd8-be55-b5e73b1c2400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:05.699179 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2dcc4-4657-4dd8-be55-b5e73b1c2400 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:05.699455 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2dcc4-4657-4dd8-be55-b5e73b1c2400 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:05.699729 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2dcc4-4657-4dd8-be55-b5e73b1c2400 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:05.700441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2dcc4-4657-4dd8-be55-b5e73b1c2400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:05.700746 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2dcc4-4657-4dd8-be55-b5e73b1c2400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:05.702158 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2dcc4-4657-4dd8-be55-b5e73b1c2400 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:05.715700 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 368/748] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:05.871560 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efb65a-c3a7-4ad5-bc76-47245534e836 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:05.871951 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efb65a-c3a7-4ad5-bc76-47245534e836 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:05.872129 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efb65a-c3a7-4ad5-bc76-47245534e836 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:05.873686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 381/749] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:05.879735 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd968974-ecd5-418d-87bc-68d0d16ab4f8 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:05.880054 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd968974-ecd5-418d-87bc-68d0d16ab4f8 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:05.880310 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd968974-ecd5-418d-87bc-68d0d16ab4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:05.900131 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-cd968974-ecd5-418d-87bc-68d0d16ab4f8 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:05.901344 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-cd968974-ecd5-418d-87bc-68d0d16ab4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:05.975310 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 369/750] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:05 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:05.999313 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efb65a-c3a7-4ad5-bc76-47245534e836 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:06.020178 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:06.109809 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efb65a-c3a7-4ad5-bc76-47245534e836 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:06.144152 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cffe90-27b0-4b53-a337-724e3ac94406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:06.144798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cffe90-27b0-4b53-a337-724e3ac94406 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:06.145085 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cffe90-27b0-4b53-a337-724e3ac94406 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:06.145365 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cffe90-27b0-4b53-a337-724e3ac94406 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:06.145996 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cffe90-27b0-4b53-a337-724e3ac94406 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:06.147416 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cffe90-27b0-4b53-a337-724e3ac94406 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-b2cffe90-27b0-4b53-a337-724e3ac94406 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:06.156487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:06.157489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:06.158882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 382/751] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:53:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:06.164375 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd968974-ecd5-418d-87bc-68d0d16ab4f8 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:06.225888 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:06.266013 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd968974-ecd5-418d-87bc-68d0d16ab4f8 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:06.303925 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72fdef-dfea-448a-ac0e-152670a5f5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:06.304550 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72fdef-dfea-448a-ac0e-152670a5f5e6 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:06.304834 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72fdef-dfea-448a-ac0e-152670a5f5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:06.305108 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72fdef-dfea-448a-ac0e-152670a5f5e6 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:06.305789 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72fdef-dfea-448a-ac0e-152670a5f5e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:06.306106 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72fdef-dfea-448a-ac0e-152670a5f5e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:06.307512 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72fdef-dfea-448a-ac0e-152670a5f5e6 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:06.312081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 370/752] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:53:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:06.318676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cffe90-27b0-4b53-a337-724e3ac94406 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:06.404247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:06.423102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cffe90-27b0-4b53-a337-724e3ac94406 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:06.423383 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642f47b-af34-4926-91e8-8adac6845a8e None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:06.423676 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642f47b-af34-4926-91e8-8adac6845a8e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:06.424499 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642f47b-af34-4926-91e8-8adac6845a8e None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:06.425830 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 371/753] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:53:06.430925 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264dc3d-9ad6-459c-b183-468baee771ff None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:06.431217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264dc3d-9ad6-459c-b183-468baee771ff None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:06.431496 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264dc3d-9ad6-459c-b183-468baee771ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:06.450043 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-3264dc3d-9ad6-459c-b183-468baee771ff None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:06.451265 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-3264dc3d-9ad6-459c-b183-468baee771ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:06.459377 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864d078-bd2b-43c0-bf3a-ca4d079ff9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:06.460005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864d078-bd2b-43c0-bf3a-ca4d079ff9e9 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:06.460290 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864d078-bd2b-43c0-bf3a-ca4d079ff9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:06.460569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864d078-bd2b-43c0-bf3a-ca4d079ff9e9 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:06.461249 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864d078-bd2b-43c0-bf3a-ca4d079ff9e9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:06.461557 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864d078-bd2b-43c0-bf3a-ca4d079ff9e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:06.462968 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864d078-bd2b-43c0-bf3a-ca4d079ff9e9 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:06.467686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 383/754] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:53:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:06.522162 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 372/755] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:06 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:06.545828 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864d078-bd2b-43c0-bf3a-ca4d079ff9e9 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:06.654932 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864d078-bd2b-43c0-bf3a-ca4d079ff9e9 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:06.688696 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e494f86-5b3e-4fc4-a93b-257b10d461bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:06.689343 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494f86-5b3e-4fc4-a93b-257b10d461bc None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:06.690389 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494f86-5b3e-4fc4-a93b-257b10d461bc None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:06.690795 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494f86-5b3e-4fc4-a93b-257b10d461bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:06.691452 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e494f86-5b3e-4fc4-a93b-257b10d461bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:06.692860 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e494f86-5b3e-4fc4-a93b-257b10d461bc None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-3e494f86-5b3e-4fc4-a93b-257b10d461bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:06.701645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:06.702731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:06.703934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 384/756] 10.222.0.73 () {56 vars in 1132 bytes} [Wed Jul 27 17:53:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:06.708885 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264dc3d-9ad6-459c-b183-468baee771ff None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:06.766733 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:06.812224 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264dc3d-9ad6-459c-b183-468baee771ff None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:06.845460 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ae914-3bf3-4ed3-8572-99fdd6e61e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:06.846832 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ae914-3bf3-4ed3-8572-99fdd6e61e49 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:06.847115 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ae914-3bf3-4ed3-8572-99fdd6e61e49 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:06.847383 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ae914-3bf3-4ed3-8572-99fdd6e61e49 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:06.848054 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ae914-3bf3-4ed3-8572-99fdd6e61e49 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:06.848355 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ae914-3bf3-4ed3-8572-99fdd6e61e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:06.849726 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ae914-3bf3-4ed3-8572-99fdd6e61e49 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:06.854217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 373/757] 10.222.0.73 () {56 vars in 1126 bytes} [Wed Jul 27 17:53:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:06.859913 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e494f86-5b3e-4fc4-a93b-257b10d461bc None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:06.873452 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:06.962074 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e494f86-5b3e-4fc4-a93b-257b10d461bc None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:06.997247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2e8c-9f90-493d-b021-084eaf9b6701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:06.997869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2e8c-9f90-493d-b021-084eaf9b6701 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:06.998153 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2e8c-9f90-493d-b021-084eaf9b6701 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:06.998431 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2e8c-9f90-493d-b021-084eaf9b6701 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:06.999214 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2e8c-9f90-493d-b021-084eaf9b6701 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:06.999522 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2e8c-9f90-493d-b021-084eaf9b6701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:07.000893 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2e8c-9f90-493d-b021-084eaf9b6701 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:07.005482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 385/758] 10.222.0.73 () {56 vars in 1126 bytes} [Wed Jul 27 17:53:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:08.693229 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2b33-766a-46a1-897b-46ed6a35b1da None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:08.693792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2b33-766a-46a1-897b-46ed6a35b1da None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:08.693792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2b33-766a-46a1-897b-46ed6a35b1da None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:08.695260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 374/759] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:08.700353 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb468cb-7cd1-4af6-91fe-ffb1f64e59b7 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:08.700804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb468cb-7cd1-4af6-91fe-ffb1f64e59b7 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:08.700896 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb468cb-7cd1-4af6-91fe-ffb1f64e59b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:08.719471 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-6bb468cb-7cd1-4af6-91fe-ffb1f64e59b7 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:08.720667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-6bb468cb-7cd1-4af6-91fe-ffb1f64e59b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:08.787966 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 386/760] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:08 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:08.811273 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc2b33-766a-46a1-897b-46ed6a35b1da None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:08.917419 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc2b33-766a-46a1-897b-46ed6a35b1da None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:08.937165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:08.951470 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e65991-86c8-40d6-b715-3a90be339304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:08.952028 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65991-86c8-40d6-b715-3a90be339304 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:08.952308 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65991-86c8-40d6-b715-3a90be339304 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:08.952597 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65991-86c8-40d6-b715-3a90be339304 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:08.953281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e65991-86c8-40d6-b715-3a90be339304 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:08.954676 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e65991-86c8-40d6-b715-3a90be339304 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:08.970602 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 375/761] 10.222.0.73 () {60 vars in 1141 bytes} [Wed Jul 27 17:53:08 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:53:09.273808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a197079-f22e-4e53-a707-dd2d5eeb11fa None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:09.274035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a197079-f22e-4e53-a707-dd2d5eeb11fa None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:09.274320 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a197079-f22e-4e53-a707-dd2d5eeb11fa None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:09.275692 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 387/762] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:09.281196 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6dec-4365-45c1-b4d6-363467695e4d None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:09.281488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6dec-4365-45c1-b4d6-363467695e4d None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:09.281771 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6dec-4365-45c1-b4d6-363467695e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:09.300299 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-efea6dec-4365-45c1-b4d6-363467695e4d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:09.301487 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-efea6dec-4365-45c1-b4d6-363467695e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:09.374576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 376/763] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:09 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:09.400133 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a197079-f22e-4e53-a707-dd2d5eeb11fa None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:09.404234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:09.507451 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a197079-f22e-4e53-a707-dd2d5eeb11fa None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:09.542075 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c27d44-88f1-4966-96c3-725e22cd87e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:09.542656 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c27d44-88f1-4966-96c3-725e22cd87e0 None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:09.542949 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c27d44-88f1-4966-96c3-725e22cd87e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:09.543228 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c27d44-88f1-4966-96c3-725e22cd87e0 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:09.543934 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c27d44-88f1-4966-96c3-725e22cd87e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:09.545307 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c27d44-88f1-4966-96c3-725e22cd87e0 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:09.560912 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 388/764] 10.222.0.73 () {60 vars in 1141 bytes} [Wed Jul 27 17:53:09 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:53:11.230746 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a82695-4ddb-45e8-aa4d-2dd6fae6742e None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:11.231268 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a82695-4ddb-45e8-aa4d-2dd6fae6742e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:11.231374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a82695-4ddb-45e8-aa4d-2dd6fae6742e None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:11.232685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 377/765] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:11.238627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99057b81-6a5d-4402-a7ef-d9b82403c5c3 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:11.239047 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99057b81-6a5d-4402-a7ef-d9b82403c5c3 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:11.239184 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99057b81-6a5d-4402-a7ef-d9b82403c5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:11.257546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-99057b81-6a5d-4402-a7ef-d9b82403c5c3 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:11.258775 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-99057b81-6a5d-4402-a7ef-d9b82403c5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:11.317646 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:11.332985 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 389/766] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:11 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:11.356847 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a82695-4ddb-45e8-aa4d-2dd6fae6742e None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:11.463290 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a82695-4ddb-45e8-aa4d-2dd6fae6742e None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:11.470605 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:11.499298 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112fbb5-d6ed-4cd6-ad92-a146102eacf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:11.499781 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112fbb5-d6ed-4cd6-ad92-a146102eacf8 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:11.500063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112fbb5-d6ed-4cd6-ad92-a146102eacf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:11.500341 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112fbb5-d6ed-4cd6-ad92-a146102eacf8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:11.500971 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112fbb5-d6ed-4cd6-ad92-a146102eacf8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:11.502386 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112fbb5-d6ed-4cd6-ad92-a146102eacf8 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-5112fbb5-d6ed-4cd6-ad92-a146102eacf8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:11.512439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:11.513615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:11.514483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 378/767] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:53:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:11.520102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99057b81-6a5d-4402-a7ef-d9b82403c5c3 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:11.623668 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99057b81-6a5d-4402-a7ef-d9b82403c5c3 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:11.657440 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7bc2e-fccb-46f6-84ed-6531e4941a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:11.658064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7bc2e-fccb-46f6-84ed-6531e4941a8b None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:11.658932 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7bc2e-fccb-46f6-84ed-6531e4941a8b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:11.659221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7bc2e-fccb-46f6-84ed-6531e4941a8b None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:11.659892 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7bc2e-fccb-46f6-84ed-6531e4941a8b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:11.660195 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7bc2e-fccb-46f6-84ed-6531e4941a8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:11.661568 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7bc2e-fccb-46f6-84ed-6531e4941a8b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:11.666102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 390/768] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:53:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:11.671932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112fbb5-d6ed-4cd6-ad92-a146102eacf8 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:11.784154 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112fbb5-d6ed-4cd6-ad92-a146102eacf8 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:11.821594 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd57f85-0c26-429f-b313-82ae74ac6de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:11.822211 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd57f85-0c26-429f-b313-82ae74ac6de6 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:11.822492 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd57f85-0c26-429f-b313-82ae74ac6de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:11.822794 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd57f85-0c26-429f-b313-82ae74ac6de6 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:11.823472 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd57f85-0c26-429f-b313-82ae74ac6de6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:11.823781 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd57f85-0c26-429f-b313-82ae74ac6de6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:11.825182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd57f85-0c26-429f-b313-82ae74ac6de6 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:11.830062 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 379/769] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:53:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:53:11.836240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7bc2e-fccb-46f6-84ed-6531e4941a8b None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:11.872418 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1f02f-bd62-42eb-acc0-6eabd9c7c40e None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:11.872711 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1f02f-bd62-42eb-acc0-6eabd9c7c40e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:11.872996 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1f02f-bd62-42eb-acc0-6eabd9c7c40e None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:11.874339 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 380/770] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:11.879747 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca34df-b887-489d-807a-2f9cf7f04b3d None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:11.879934 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca34df-b887-489d-807a-2f9cf7f04b3d None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:11.880210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca34df-b887-489d-807a-2f9cf7f04b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:11.895214 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:11.898388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-0fca34df-b887-489d-807a-2f9cf7f04b3d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:11.899621 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-0fca34df-b887-489d-807a-2f9cf7f04b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:11.927508 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:11.941598 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7bc2e-fccb-46f6-84ed-6531e4941a8b None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:11.968522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 381/771] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:11 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 17:53:11.977371 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8c199-71ef-40c3-b5c4-ec370782bd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:11.977995 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8c199-71ef-40c3-b5c4-ec370782bd89 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:11.978282 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8c199-71ef-40c3-b5c4-ec370782bd89 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:11.978587 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8c199-71ef-40c3-b5c4-ec370782bd89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:11.979346 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8c199-71ef-40c3-b5c4-ec370782bd89 None admin] RBAC: Adding query filter params (interface=public, service_id=685b8ef4be704bd08d9761e6a06a6d1d, region_id=RegionOne) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:11.979663 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8c199-71ef-40c3-b5c4-ec370782bd89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:11.981036 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8c199-71ef-40c3-b5c4-ec370782bd89 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:11.986215 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 391/772] 10.222.0.73 () {56 vars in 1251 bytes} [Wed Jul 27 17:53:11 2022] GET /identity/v3/endpoints?service_id=685b8ef4be704bd08d9761e6a06a6d1d&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:11.991959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca34df-b887-489d-807a-2f9cf7f04b3d None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:11.992342 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8c199-71ef-40c3-b5c4-ec370782bd89 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:12.096704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca34df-b887-489d-807a-2f9cf7f04b3d None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:12.098950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8c199-71ef-40c3-b5c4-ec370782bd89 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:12.115837 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:12.131490 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac0083-7ad5-47c1-aad8-bd76e130446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:12.132118 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0083-7ad5-47c1-aad8-bd76e130446c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:12.132402 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0083-7ad5-47c1-aad8-bd76e130446c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:12.132567 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9901ef-3d7e-4db8-9874-d785c4068a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:12.132691 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0083-7ad5-47c1-aad8-bd76e130446c None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:12.133233 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9901ef-3d7e-4db8-9874-d785c4068a8b None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:12.133323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac0083-7ad5-47c1-aad8-bd76e130446c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:12.133503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9901ef-3d7e-4db8-9874-d785c4068a8b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:12.133784 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9901ef-3d7e-4db8-9874-d785c4068a8b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:12.134412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9901ef-3d7e-4db8-9874-d785c4068a8b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:12.134724 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac0083-7ad5-47c1-aad8-bd76e130446c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:12.135798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9901ef-3d7e-4db8-9874-d785c4068a8b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:12.140612 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 382/773] 10.222.0.73 () {56 vars in 1087 bytes} [Wed Jul 27 17:53:11 2022] GET /identity/v3/services => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-0f9901ef-3d7e-4db8-9874-d785c4068a8b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:12.145319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:12.146482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 17:53:12.147905 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:12.150909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 392/774] 10.222.0.73 () {56 vars in 1132 bytes} [Wed Jul 27 17:53:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:53:12.152969 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac0083-7ad5-47c1-aad8-bd76e130446c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:12.183323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:12.259386 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac0083-7ad5-47c1-aad8-bd76e130446c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:12.295309 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb89ed-2be3-4dbf-9714-c03d9a8a369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:12.295860 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb89ed-2be3-4dbf-9714-c03d9a8a369b None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:12.296145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb89ed-2be3-4dbf-9714-c03d9a8a369b None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:12.296426 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb89ed-2be3-4dbf-9714-c03d9a8a369b None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:12.297123 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb89ed-2be3-4dbf-9714-c03d9a8a369b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:12.297435 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb89ed-2be3-4dbf-9714-c03d9a8a369b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:12.298854 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb89ed-2be3-4dbf-9714-c03d9a8a369b None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:12.304326 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 383/775] 10.222.0.73 () {56 vars in 1126 bytes} [Wed Jul 27 17:53:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:12.310129 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9901ef-3d7e-4db8-9874-d785c4068a8b None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:12.412143 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9901ef-3d7e-4db8-9874-d785c4068a8b None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:12.445565 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fce71-572b-4d7b-a275-ae6143fa58a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:12.446188 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fce71-572b-4d7b-a275-ae6143fa58a8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:12.446472 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fce71-572b-4d7b-a275-ae6143fa58a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:12.446781 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fce71-572b-4d7b-a275-ae6143fa58a8 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:12.447463 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fce71-572b-4d7b-a275-ae6143fa58a8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:12.447774 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fce71-572b-4d7b-a275-ae6143fa58a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:12.449136 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fce71-572b-4d7b-a275-ae6143fa58a8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:12.453886 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 393/776] 10.222.0.73 () {56 vars in 1126 bytes} [Wed Jul 27 17:53:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:12.460099 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb89ed-2be3-4dbf-9714-c03d9a8a369b None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:12.552471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:12.561571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb89ed-2be3-4dbf-9714-c03d9a8a369b None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:12.595552 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d74503-c347-4201-bcf8-000a4e973837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:12.597406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d74503-c347-4201-bcf8-000a4e973837 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:12.597697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d74503-c347-4201-bcf8-000a4e973837 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:12.597984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d74503-c347-4201-bcf8-000a4e973837 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:12.598774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d74503-c347-4201-bcf8-000a4e973837 None admin] RBAC: Adding query filter params (interface=public, service_id=abefeb2638ff4530ae329179695ef8d0, region_id=RegionOne) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:12.599099 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d74503-c347-4201-bcf8-000a4e973837 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:12.600474 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d74503-c347-4201-bcf8-000a4e973837 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:12.605829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 384/777] 10.222.0.73 () {56 vars in 1251 bytes} [Wed Jul 27 17:53:12 2022] GET /identity/v3/endpoints?service_id=abefeb2638ff4530ae329179695ef8d0&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:12.611353 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fce71-572b-4d7b-a275-ae6143fa58a8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:12.663200 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:12.716490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fce71-572b-4d7b-a275-ae6143fa58a8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:12.750191 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5a02-b058-4e85-bc51-23f172e7d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:12.750840 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5a02-b058-4e85-bc51-23f172e7d59e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:12.751125 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5a02-b058-4e85-bc51-23f172e7d59e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:12.751404 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5a02-b058-4e85-bc51-23f172e7d59e None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:12.752085 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5a02-b058-4e85-bc51-23f172e7d59e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:12.754034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5a02-b058-4e85-bc51-23f172e7d59e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:12.762876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 394/778] 10.222.0.73 () {56 vars in 1087 bytes} [Wed Jul 27 17:53:12 2022] GET /identity/v3/services => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 17:53:14.378106 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3b36-3003-44a9-b1e0-976946e8c086 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:14.378675 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3b36-3003-44a9-b1e0-976946e8c086 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:14.378879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3b36-3003-44a9-b1e0-976946e8c086 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:14.380236 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 385/779] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:14.385590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c83a28-de95-4073-a883-bcaf1dcef732 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:14.386049 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c83a28-de95-4073-a883-bcaf1dcef732 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:14.386143 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c83a28-de95-4073-a883-bcaf1dcef732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:14.404756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-71c83a28-de95-4073-a883-bcaf1dcef732 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:14.405927 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-71c83a28-de95-4073-a883-bcaf1dcef732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:14.471652 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 395/780] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:14 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:14.496935 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c3b36-3003-44a9-b1e0-976946e8c086 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:14.599967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c3b36-3003-44a9-b1e0-976946e8c086 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:14.634092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83881-33bc-4491-8e72-8750d3cf0e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:14.634701 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83881-33bc-4491-8e72-8750d3cf0e02 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:14.634989 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83881-33bc-4491-8e72-8750d3cf0e02 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:14.635268 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83881-33bc-4491-8e72-8750d3cf0e02 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:14.635899 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f83881-33bc-4491-8e72-8750d3cf0e02 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:14.637267 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f83881-33bc-4491-8e72-8750d3cf0e02 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-d6f83881-33bc-4491-8e72-8750d3cf0e02 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:14.646876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:14.647999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:14.649153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 386/781] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:53:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:14.654834 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c83a28-de95-4073-a883-bcaf1dcef732 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:14.698392 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:14.756125 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c83a28-de95-4073-a883-bcaf1dcef732 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:14.791153 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2d474-2a30-4172-8032-dd56828ed1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:14.791771 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2d474-2a30-4172-8032-dd56828ed1bf None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:14.792052 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2d474-2a30-4172-8032-dd56828ed1bf None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:14.792324 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2d474-2a30-4172-8032-dd56828ed1bf None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:14.793001 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2d474-2a30-4172-8032-dd56828ed1bf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:14.793303 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2d474-2a30-4172-8032-dd56828ed1bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:14.794709 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2d474-2a30-4172-8032-dd56828ed1bf None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:14.800087 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 396/782] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:53:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:14.805860 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83881-33bc-4491-8e72-8750d3cf0e02 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:14.829009 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:14.913450 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83881-33bc-4491-8e72-8750d3cf0e02 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:14.947924 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b15a6-8200-43dc-a702-3c3864543bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:14.948541 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b15a6-8200-43dc-a702-3c3864543bf5 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:14.948828 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b15a6-8200-43dc-a702-3c3864543bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:14.949106 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b15a6-8200-43dc-a702-3c3864543bf5 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:14.949781 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b15a6-8200-43dc-a702-3c3864543bf5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:14.950093 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b15a6-8200-43dc-a702-3c3864543bf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:14.951494 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b15a6-8200-43dc-a702-3c3864543bf5 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:14.956273 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 387/783] 10.222.0.73 () {56 vars in 1114 bytes} [Wed Jul 27 17:53:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:14.962010 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2d474-2a30-4172-8032-dd56828ed1bf None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:15.040027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04045ead-bffb-4b06-9157-532362d96cc7 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:15.040460 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04045ead-bffb-4b06-9157-532362d96cc7 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:15.040745 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04045ead-bffb-4b06-9157-532362d96cc7 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:15.042188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 388/784] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:15.048165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23453-d753-406d-ba0a-26d881a33e0c None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:15.048453 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23453-d753-406d-ba0a-26d881a33e0c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:15.048734 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23453-d753-406d-ba0a-26d881a33e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:15.068337 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2d474-2a30-4172-8032-dd56828ed1bf None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:15.070078 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-8cd23453-d753-406d-ba0a-26d881a33e0c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:15.071211 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:15.071327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-8cd23453-d753-406d-ba0a-26d881a33e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:15.106279 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f19a35-2d1b-4749-af5f-6fa09228539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:15.106933 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f19a35-2d1b-4749-af5f-6fa09228539b None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:15.107216 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f19a35-2d1b-4749-af5f-6fa09228539b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:15.107488 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f19a35-2d1b-4749-af5f-6fa09228539b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:15.108232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f19a35-2d1b-4749-af5f-6fa09228539b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:15.109592 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f19a35-2d1b-4749-af5f-6fa09228539b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:15.129557 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 397/785] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 17:53:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 17:53:15.149456 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 389/786] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:15 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 17:53:15.175083 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f19a35-2d1b-4749-af5f-6fa09228539b None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:15.281601 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f19a35-2d1b-4749-af5f-6fa09228539b None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:15.317163 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546739e8-aced-4dc6-b47b-d7b8062646ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:15.317818 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546739e8-aced-4dc6-b47b-d7b8062646ce None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:15.318105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546739e8-aced-4dc6-b47b-d7b8062646ce None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:15.318379 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546739e8-aced-4dc6-b47b-d7b8062646ce None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:15.319048 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546739e8-aced-4dc6-b47b-d7b8062646ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:15.320436 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546739e8-aced-4dc6-b47b-d7b8062646ce None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-546739e8-aced-4dc6-b47b-d7b8062646ce None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:15.329866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:15.330977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:15.331838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 398/787] 10.222.0.73 () {56 vars in 1132 bytes} [Wed Jul 27 17:53:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:15.338029 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd23453-d753-406d-ba0a-26d881a33e0c None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:15.351318 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:15.447479 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd23453-d753-406d-ba0a-26d881a33e0c None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:15.481998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d99e8e-2304-438c-8cb2-59bb9bd3981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:15.482652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d99e8e-2304-438c-8cb2-59bb9bd3981f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:15.482939 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d99e8e-2304-438c-8cb2-59bb9bd3981f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:15.483220 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d99e8e-2304-438c-8cb2-59bb9bd3981f None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:15.483901 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d99e8e-2304-438c-8cb2-59bb9bd3981f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:15.484212 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d99e8e-2304-438c-8cb2-59bb9bd3981f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:15.485593 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d99e8e-2304-438c-8cb2-59bb9bd3981f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:15.490247 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 390/788] 10.222.0.73 () {56 vars in 1126 bytes} [Wed Jul 27 17:53:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:15.496187 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546739e8-aced-4dc6-b47b-d7b8062646ce None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:15.522314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:15.598908 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546739e8-aced-4dc6-b47b-d7b8062646ce None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:15.632048 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec7ceb-99a7-4c28-8ad4-0c3ffa16d2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:15.632677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec7ceb-99a7-4c28-8ad4-0c3ffa16d2d3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:15.632963 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec7ceb-99a7-4c28-8ad4-0c3ffa16d2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:15.633244 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec7ceb-99a7-4c28-8ad4-0c3ffa16d2d3 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:15.633929 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec7ceb-99a7-4c28-8ad4-0c3ffa16d2d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:15.634233 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec7ceb-99a7-4c28-8ad4-0c3ffa16d2d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:15.635655 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec7ceb-99a7-4c28-8ad4-0c3ffa16d2d3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:15.640428 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 399/789] 10.222.0.73 () {56 vars in 1126 bytes} [Wed Jul 27 17:53:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:15.646945 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d99e8e-2304-438c-8cb2-59bb9bd3981f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:15.724428 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:15.750863 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d99e8e-2304-438c-8cb2-59bb9bd3981f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:15.786172 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb2d13-2d7d-4d1b-a01a-8dd4e4290597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:15.786833 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb2d13-2d7d-4d1b-a01a-8dd4e4290597 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:15.787118 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb2d13-2d7d-4d1b-a01a-8dd4e4290597 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:15.787396 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb2d13-2d7d-4d1b-a01a-8dd4e4290597 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:15.788092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb2d13-2d7d-4d1b-a01a-8dd4e4290597 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:15.789447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb2d13-2d7d-4d1b-a01a-8dd4e4290597 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:15.811114 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 391/790] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 17:53:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 17:53:17.437319 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01244-bb3a-4a77-bb31-83bdc289c8c3 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:17.437900 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01244-bb3a-4a77-bb31-83bdc289c8c3 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:17.437900 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01244-bb3a-4a77-bb31-83bdc289c8c3 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:17.439249 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 400/791] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:17.444767 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ee522-c9ce-49f3-8f0b-def793485bb2 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:17.445206 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ee522-c9ce-49f3-8f0b-def793485bb2 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:17.445297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ee522-c9ce-49f3-8f0b-def793485bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:17.463063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-474ee522-c9ce-49f3-8f0b-def793485bb2 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:17.464238 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-474ee522-c9ce-49f3-8f0b-def793485bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:17.536951 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 392/792] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:17 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:17.560651 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe01244-bb3a-4a77-bb31-83bdc289c8c3 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:17.653758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:17.667802 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe01244-bb3a-4a77-bb31-83bdc289c8c3 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:17.701924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b69ff-ade1-433c-80e1-6627af255be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:17.702471 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b69ff-ade1-433c-80e1-6627af255be7 None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:17.702798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b69ff-ade1-433c-80e1-6627af255be7 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:17.703069 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b69ff-ade1-433c-80e1-6627af255be7 None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:17.703758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b69ff-ade1-433c-80e1-6627af255be7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:17.705194 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b69ff-ade1-433c-80e1-6627af255be7 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:17.707920 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: WARNING keystone.server.flask.common [None req-d65b69ff-ade1-433c-80e1-6627af255be7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 17:53:17.729041 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.sql.core [None req-d65b69ff-ade1-433c-80e1-6627af255be7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 17:53:17.729041 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 17:53:17.729041 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [parameters: {'id': '1f90d40fe2fe425e9741be424b0894bf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 17:53:17.729041 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87221) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-d65b69ff-ade1-433c-80e1-6627af255be7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1f90d40fe2fe425e9741be424b0894bf.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1f90d40fe2fe425e9741be424b0894bf. Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application conn.query(q) Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 17:53:17.745613 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application result.read() Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 17:53:17.746726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application next(self.gen) Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application yield resource Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application next(self.gen) Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise self.value Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application session.commit() Jul 27 17:53:17.747769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self.session.flush() Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application compat.raise_( Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 17:53:17.748869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 17:53:17.749880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application conn.query(q) Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application result.read() Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 17:53:17.751977 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [parameters: {'id': '1f90d40fe2fe425e9741be424b0894bf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:17.753921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:17.754962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:17.756109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:17.756109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 17:53:17.756109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 17:53:17.756109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:17.756109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:17.756109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 17:53:17.756109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 17:53:17.756109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1f90d40fe2fe425e9741be424b0894bf. Jul 27 17:53:17.756109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:17.756109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 401/793] 10.222.0.73 () {60 vars in 1140 bytes} [Wed Jul 27 17:53:17 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:17.756803 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ee522-c9ce-49f3-8f0b-def793485bb2 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:17.813255 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:17.858097 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ee522-c9ce-49f3-8f0b-def793485bb2 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:17.892786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49ec76-6a4b-4771-b36c-1f02e704dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:17.893473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49ec76-6a4b-4771-b36c-1f02e704dd57 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:17.893752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49ec76-6a4b-4771-b36c-1f02e704dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:17.894020 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49ec76-6a4b-4771-b36c-1f02e704dd57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:17.901075 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49ec76-6a4b-4771-b36c-1f02e704dd57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:17.902828 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49ec76-6a4b-4771-b36c-1f02e704dd57 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-9e49ec76-6a4b-4771-b36c-1f02e704dd57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:53:17.914743 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:17.915778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:17.916706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:53:17.916706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:53:17.916706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:53:17.916706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:53:17.916706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:53:17.916706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:53:17.916706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:53:17.916706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:17.916706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 393/794] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:53:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:17.922562 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b69ff-ade1-433c-80e1-6627af255be7 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:18.035435 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b69ff-ade1-433c-80e1-6627af255be7 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:18.078832 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03992301-761f-47a3-91b0-93ca29a23ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:18.079681 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03992301-761f-47a3-91b0-93ca29a23ea8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:18.079959 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03992301-761f-47a3-91b0-93ca29a23ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:18.080234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03992301-761f-47a3-91b0-93ca29a23ea8 None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:18.081054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03992301-761f-47a3-91b0-93ca29a23ea8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:18.081360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03992301-761f-47a3-91b0-93ca29a23ea8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:18.083037 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03992301-761f-47a3-91b0-93ca29a23ea8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:18.085642 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8c25-50f2-4d03-a4a2-c058dd778ed7 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:18.085932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8c25-50f2-4d03-a4a2-c058dd778ed7 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:18.086215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8c25-50f2-4d03-a4a2-c058dd778ed7 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:18.087633 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 394/795] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:53:18.093210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6febe-6955-47a5-bb8b-bfa15226ab3c None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:18.093499 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6febe-6955-47a5-bb8b-bfa15226ab3c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:18.093784 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6febe-6955-47a5-bb8b-bfa15226ab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:18.105045 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 402/796] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:53:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:18.116843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-bdd6febe-6955-47a5-bb8b-bfa15226ab3c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:18.118160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-bdd6febe-6955-47a5-bb8b-bfa15226ab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:18.198651 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 395/797] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:18 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 17:53:18.225622 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03992301-761f-47a3-91b0-93ca29a23ea8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:18.229984 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:18.359279 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03992301-761f-47a3-91b0-93ca29a23ea8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:18.405211 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cddbf-5761-4baa-85a5-3c83dd536225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:18.405893 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cddbf-5761-4baa-85a5-3c83dd536225 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:18.407064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cddbf-5761-4baa-85a5-3c83dd536225 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:18.407064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cddbf-5761-4baa-85a5-3c83dd536225 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:18.407267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cddbf-5761-4baa-85a5-3c83dd536225 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:18.408651 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cddbf-5761-4baa-85a5-3c83dd536225 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-2f1cddbf-5761-4baa-85a5-3c83dd536225 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:18.419081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:18.420137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 17:53:18.421003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:18.422595 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 403/798] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:53:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:18.427285 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6febe-6955-47a5-bb8b-bfa15226ab3c None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:18.480597 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:18.548775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6febe-6955-47a5-bb8b-bfa15226ab3c None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:18.587626 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb3b7c-e4aa-4ffa-bd12-d425d040e3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:18.587981 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb3b7c-e4aa-4ffa-bd12-d425d040e3f0 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:18.588244 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb3b7c-e4aa-4ffa-bd12-d425d040e3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:18.588457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb3b7c-e4aa-4ffa-bd12-d425d040e3f0 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:18.589244 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb3b7c-e4aa-4ffa-bd12-d425d040e3f0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:18.589558 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb3b7c-e4aa-4ffa-bd12-d425d040e3f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:18.591064 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb3b7c-e4aa-4ffa-bd12-d425d040e3f0 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:18.598676 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 396/799] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:53:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:18.604702 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cddbf-5761-4baa-85a5-3c83dd536225 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:18.682481 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:18.728757 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cddbf-5761-4baa-85a5-3c83dd536225 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:18.768731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da24e1a-3f13-4062-a8f7-6b336ab8086d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:18.769426 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24e1a-3f13-4062-a8f7-6b336ab8086d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:18.769842 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24e1a-3f13-4062-a8f7-6b336ab8086d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:18.770085 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24e1a-3f13-4062-a8f7-6b336ab8086d None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:18.771251 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da24e1a-3f13-4062-a8f7-6b336ab8086d None admin] RBAC: Adding query filter params (type=compute) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:18.771607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da24e1a-3f13-4062-a8f7-6b336ab8086d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:18.773648 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da24e1a-3f13-4062-a8f7-6b336ab8086d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:18.781838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 404/800] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:53:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:20.555069 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6426f-d6aa-4e42-b9d7-b1ca5813a174 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:20.555871 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6426f-d6aa-4e42-b9d7-b1ca5813a174 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:20.555871 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6426f-d6aa-4e42-b9d7-b1ca5813a174 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:20.557013 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 397/801] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:20.562726 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac63b57-7798-4f47-8f77-aa0644f8150b None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:20.563314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac63b57-7798-4f47-8f77-aa0644f8150b None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:20.563314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac63b57-7798-4f47-8f77-aa0644f8150b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:20.581543 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-2ac63b57-7798-4f47-8f77-aa0644f8150b None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:20.583081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-2ac63b57-7798-4f47-8f77-aa0644f8150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:20.656066 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 405/802] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:20.681709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6426f-d6aa-4e42-b9d7-b1ca5813a174 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:20.789095 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6426f-d6aa-4e42-b9d7-b1ca5813a174 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:20.802363 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:20.825587 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e3045-c50d-4af0-a55d-da2ba4bca5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:20.826208 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3045-c50d-4af0-a55d-da2ba4bca5d3 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:20.826486 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3045-c50d-4af0-a55d-da2ba4bca5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:20.826793 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3045-c50d-4af0-a55d-da2ba4bca5d3 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:20.827493 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e3045-c50d-4af0-a55d-da2ba4bca5d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:20.828929 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e3045-c50d-4af0-a55d-da2ba4bca5d3 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:20.832092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: WARNING keystone.server.flask.common [None req-826e3045-c50d-4af0-a55d-da2ba4bca5d3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 17:53:20.844347 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.sql.core [None req-826e3045-c50d-4af0-a55d-da2ba4bca5d3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 17:53:20.844347 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 17:53:20.844347 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [parameters: {'user_id': 'b4bb25e94a454cd59714cea3e55e2aea', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 17:53:20.844347 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87220) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-826e3045-c50d-4af0-a55d-da2ba4bca5d3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application conn.query(q) Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application result.read() Jul 27 17:53:20.861081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 17:53:20.862696 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application next(self.gen) Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application yield resource Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application next(self.gen) Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise self.value Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application session.commit() Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 17:53:20.863719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self.session.flush() Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application compat.raise_( Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 17:53:20.864611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 17:53:20.865522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application conn.query(q) Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application result.read() Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 17:53:20.866408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b4bb25e94a454cd59714cea3e55e2aea', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:20.867523 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 17:53:20.868741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 17:53:20.869879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 17:53:20.869879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 17:53:20.869879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 17:53:20.869879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 17:53:20.869879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 17:53:20.869879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:20.869879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 398/803] 10.222.0.73 () {60 vars in 1131 bytes} [Wed Jul 27 17:53:20 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:20.870676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac63b57-7798-4f47-8f77-aa0644f8150b None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:20.936182 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:20.976861 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac63b57-7798-4f47-8f77-aa0644f8150b None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:21.010788 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83d79f-9ef4-42b2-9c0f-9eee5f8e3d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:21.011429 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d79f-9ef4-42b2-9c0f-9eee5f8e3d5f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:21.011720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d79f-9ef4-42b2-9c0f-9eee5f8e3d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:21.011993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d79f-9ef4-42b2-9c0f-9eee5f8e3d5f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:21.020212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83d79f-9ef4-42b2-9c0f-9eee5f8e3d5f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:21.021663 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83d79f-9ef4-42b2-9c0f-9eee5f8e3d5f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-ac83d79f-9ef4-42b2-9c0f-9eee5f8e3d5f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:53:21.034003 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:21.035300 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:21.036563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:21.036563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:21.036563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:53:21.036563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:53:21.036563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:53:21.036563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:53:21.036563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:53:21.036563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:53:21.036563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 17:53:21.036563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:21.038663 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 406/804] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:53:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:21.042117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83d79f-9ef4-42b2-9c0f-9eee5f8e3d5f None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:21.042735 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8cbfc-d0e8-45db-b217-d88a4f2031f4 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:21.043027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8cbfc-d0e8-45db-b217-d88a4f2031f4 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:21.043302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8cbfc-d0e8-45db-b217-d88a4f2031f4 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:21.047582 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 399/805] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:21.053489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5e613-9ced-4a65-9760-2bbbe62aa295 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:21.053845 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5e613-9ced-4a65-9760-2bbbe62aa295 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:21.054126 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5e613-9ced-4a65-9760-2bbbe62aa295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:21.073253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-2ac5e613-9ced-4a65-9760-2bbbe62aa295 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:21.074818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-2ac5e613-9ced-4a65-9760-2bbbe62aa295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:21.151090 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83d79f-9ef4-42b2-9c0f-9eee5f8e3d5f None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:21.152160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 400/806] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:21 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:21.173910 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:21.175628 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5e613-9ced-4a65-9760-2bbbe62aa295 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:21.187182 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417530fc-7eee-4deb-b3ed-75b0f828cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:21.187573 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417530fc-7eee-4deb-b3ed-75b0f828cdc6 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:21.187852 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417530fc-7eee-4deb-b3ed-75b0f828cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:21.188130 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417530fc-7eee-4deb-b3ed-75b0f828cdc6 None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:21.188887 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417530fc-7eee-4deb-b3ed-75b0f828cdc6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:21.189193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417530fc-7eee-4deb-b3ed-75b0f828cdc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:21.191151 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417530fc-7eee-4deb-b3ed-75b0f828cdc6 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:21.226620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 407/807] 10.222.0.73 () {56 vars in 1101 bytes} [Wed Jul 27 17:53:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:53:21.281666 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5e613-9ced-4a65-9760-2bbbe62aa295 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:21.283465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:21.321118 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8df39-09ab-4bbe-bad4-d3ff2383fad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:21.321751 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8df39-09ab-4bbe-bad4-d3ff2383fad1 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:21.322036 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8df39-09ab-4bbe-bad4-d3ff2383fad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:21.322305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8df39-09ab-4bbe-bad4-d3ff2383fad1 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:21.323151 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8df39-09ab-4bbe-bad4-d3ff2383fad1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:21.324663 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8df39-09ab-4bbe-bad4-d3ff2383fad1 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:21.340820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 401/808] 10.222.0.73 () {60 vars in 1141 bytes} [Wed Jul 27 17:53:21 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:53:23.553209 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55536e2-c52e-459e-8cc3-fb72f4f9d471 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:23.553739 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55536e2-c52e-459e-8cc3-fb72f4f9d471 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:23.553860 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55536e2-c52e-459e-8cc3-fb72f4f9d471 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:23.555185 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 408/809] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:23.560390 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d5ba8-7d9e-4d53-80ef-b5bccc5c55b3 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:23.560822 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d5ba8-7d9e-4d53-80ef-b5bccc5c55b3 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:23.560931 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d5ba8-7d9e-4d53-80ef-b5bccc5c55b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:23.578501 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-297d5ba8-7d9e-4d53-80ef-b5bccc5c55b3 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:23.579692 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-297d5ba8-7d9e-4d53-80ef-b5bccc5c55b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:23.651614 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 402/810] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:23 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 17:53:23.675877 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55536e2-c52e-459e-8cc3-fb72f4f9d471 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:23.782844 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55536e2-c52e-459e-8cc3-fb72f4f9d471 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:23.817833 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fae7f-bc3a-492d-af7b-45346bdd389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:23.818421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fae7f-bc3a-492d-af7b-45346bdd389f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:23.818734 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fae7f-bc3a-492d-af7b-45346bdd389f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:23.819008 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fae7f-bc3a-492d-af7b-45346bdd389f None admin] PATH_INFO: `/v3/services/compute` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:23.819637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fae7f-bc3a-492d-af7b-45346bdd389f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:23.821013 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fae7f-bc3a-492d-af7b-45346bdd389f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-783fae7f-bc3a-492d-af7b-45346bdd389f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:23.829686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:23.831650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:53:23.832751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 409/811] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:53:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:23.837738 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d5ba8-7d9e-4d53-80ef-b5bccc5c55b3 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:23.925245 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:23.937888 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d5ba8-7d9e-4d53-80ef-b5bccc5c55b3 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:23.970637 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfea9ae-8b5b-4b6e-9c46-7f711e81a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:23.971845 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea9ae-8b5b-4b6e-9c46-7f711e81a89f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:23.972121 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea9ae-8b5b-4b6e-9c46-7f711e81a89f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:23.972394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea9ae-8b5b-4b6e-9c46-7f711e81a89f None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:23.973066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfea9ae-8b5b-4b6e-9c46-7f711e81a89f None admin] RBAC: Adding query filter params (name=compute) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:23.973367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfea9ae-8b5b-4b6e-9c46-7f711e81a89f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:23.974774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfea9ae-8b5b-4b6e-9c46-7f711e81a89f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:23.979489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 403/812] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:53:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:23.985338 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fae7f-bc3a-492d-af7b-45346bdd389f None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:24.031643 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:24.090495 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fae7f-bc3a-492d-af7b-45346bdd389f None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:24.124623 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f686d-09e2-48b3-815b-6b1fc8c0adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:24.125232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f686d-09e2-48b3-815b-6b1fc8c0adfb None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:24.125516 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f686d-09e2-48b3-815b-6b1fc8c0adfb None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:24.125790 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f686d-09e2-48b3-815b-6b1fc8c0adfb None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:24.126463 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f686d-09e2-48b3-815b-6b1fc8c0adfb None admin] RBAC: Adding query filter params (type=compute) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:24.126800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f686d-09e2-48b3-815b-6b1fc8c0adfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:24.128683 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f686d-09e2-48b3-815b-6b1fc8c0adfb None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:24.133368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 410/813] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:53:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:24.139352 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfea9ae-8b5b-4b6e-9c46-7f711e81a89f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:24.236037 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfea9ae-8b5b-4b6e-9c46-7f711e81a89f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:24.269122 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67803ae2-f784-4e72-bc27-450a28605e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:24.269734 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67803ae2-f784-4e72-bc27-450a28605e1c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:24.270015 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67803ae2-f784-4e72-bc27-450a28605e1c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:24.270291 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67803ae2-f784-4e72-bc27-450a28605e1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:24.271068 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67803ae2-f784-4e72-bc27-450a28605e1c None admin] RBAC: Adding query filter params (interface=public, service_id=347d8313e384416ea339c228d1d34a8d, region_id=RegionOne) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:24.271380 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67803ae2-f784-4e72-bc27-450a28605e1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:24.272746 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67803ae2-f784-4e72-bc27-450a28605e1c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:24.277618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 404/814] 10.222.0.73 () {56 vars in 1251 bytes} [Wed Jul 27 17:53:24 2022] GET /identity/v3/endpoints?service_id=347d8313e384416ea339c228d1d34a8d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:24.283418 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f686d-09e2-48b3-815b-6b1fc8c0adfb None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:24.380706 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f686d-09e2-48b3-815b-6b1fc8c0adfb None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:24.389228 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:24.414340 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f545f-787a-43ca-b6f9-09f73ddf585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:24.414984 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f545f-787a-43ca-b6f9-09f73ddf585e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:24.415266 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f545f-787a-43ca-b6f9-09f73ddf585e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:24.415541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f545f-787a-43ca-b6f9-09f73ddf585e None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:24.416189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f545f-787a-43ca-b6f9-09f73ddf585e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:24.417561 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f545f-787a-43ca-b6f9-09f73ddf585e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:24.423718 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 411/815] 10.222.0.73 () {56 vars in 1087 bytes} [Wed Jul 27 17:53:24 2022] GET /identity/v3/services => generated 1728 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 17:53:26.642863 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41304a-49c1-4ca5-abab-975068efe815 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:26.643896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41304a-49c1-4ca5-abab-975068efe815 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:26.644010 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41304a-49c1-4ca5-abab-975068efe815 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:26.645416 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 405/816] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:53:26.650720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd33ca-303e-4a81-bbce-e898db1b454e None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:26.651114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd33ca-303e-4a81-bbce-e898db1b454e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:26.651278 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd33ca-303e-4a81-bbce-e898db1b454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:26.670116 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-b1dd33ca-303e-4a81-bbce-e898db1b454e None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:53:26.671356 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-b1dd33ca-303e-4a81-bbce-e898db1b454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:53:26.738181 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 412/817] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:53:26 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:53:26.762497 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41304a-49c1-4ca5-abab-975068efe815 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:26.782792 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:26.867172 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41304a-49c1-4ca5-abab-975068efe815 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:26.900301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd5c7-e99d-477d-b2c5-7eba53ad0a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:26.900866 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd5c7-e99d-477d-b2c5-7eba53ad0a37 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:26.901153 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd5c7-e99d-477d-b2c5-7eba53ad0a37 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:26.901433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd5c7-e99d-477d-b2c5-7eba53ad0a37 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:26.902060 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cd5c7-e99d-477d-b2c5-7eba53ad0a37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:26.903718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cd5c7-e99d-477d-b2c5-7eba53ad0a37 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-ff7cd5c7-e99d-477d-b2c5-7eba53ad0a37 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:53:26.913105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:53:26.914283 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:53:26.915369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 406/818] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:53:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:53:26.920522 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd33ca-303e-4a81-bbce-e898db1b454e None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:27.017208 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd33ca-303e-4a81-bbce-e898db1b454e None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:27.019343 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:27.053312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2ac39-1cf2-4f36-b29d-2430f5d9bdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:27.053930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2ac39-1cf2-4f36-b29d-2430f5d9bdd4 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:27.054211 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2ac39-1cf2-4f36-b29d-2430f5d9bdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:27.054484 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2ac39-1cf2-4f36-b29d-2430f5d9bdd4 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:27.055193 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2ac39-1cf2-4f36-b29d-2430f5d9bdd4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:27.055498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2ac39-1cf2-4f36-b29d-2430f5d9bdd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:27.056869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2ac39-1cf2-4f36-b29d-2430f5d9bdd4 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:27.061663 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 413/819] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:53:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:27.068206 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd5c7-e99d-477d-b2c5-7eba53ad0a37 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:27.147484 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:27.166781 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd5c7-e99d-477d-b2c5-7eba53ad0a37 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:27.199587 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab189f1-4067-4cc1-83ab-ccbf2d3541ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:27.200200 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab189f1-4067-4cc1-83ab-ccbf2d3541ad None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:27.200482 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab189f1-4067-4cc1-83ab-ccbf2d3541ad None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:27.200759 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab189f1-4067-4cc1-83ab-ccbf2d3541ad None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:27.201434 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab189f1-4067-4cc1-83ab-ccbf2d3541ad None admin] RBAC: Adding query filter params (type=compute) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:53:27.201741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab189f1-4067-4cc1-83ab-ccbf2d3541ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:27.203134 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab189f1-4067-4cc1-83ab-ccbf2d3541ad None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:27.208535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 407/820] 10.222.0.73 () {56 vars in 1112 bytes} [Wed Jul 27 17:53:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:53:27.214580 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2ac39-1cf2-4f36-b29d-2430f5d9bdd4 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:53:27.311875 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2ac39-1cf2-4f36-b29d-2430f5d9bdd4 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:53:27.346154 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556c8c5-ef10-4fa8-992a-0f0a859da82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:53:27.346822 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c8c5-ef10-4fa8-992a-0f0a859da82d None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:53:27.347100 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c8c5-ef10-4fa8-992a-0f0a859da82d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:53:27.347374 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c8c5-ef10-4fa8-992a-0f0a859da82d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:53:27.348074 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556c8c5-ef10-4fa8-992a-0f0a859da82d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:53:27.349421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556c8c5-ef10-4fa8-992a-0f0a859da82d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:53:27.368351 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 414/821] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 17:53:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:53:37.205565 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=28 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:53:37.364176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:29.703645 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7d4bb-50cf-4765-a04d-282d7c25848e None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:29.704360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7d4bb-50cf-4765-a04d-282d7c25848e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:29.704360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7d4bb-50cf-4765-a04d-282d7c25848e None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:29.705622 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 408/822] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:54:29.712603 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86fee-b83c-49a4-bfcb-e289021bc1e5 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:29.713522 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86fee-b83c-49a4-bfcb-e289021bc1e5 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:29.713677 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86fee-b83c-49a4-bfcb-e289021bc1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:29.746203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-fde86fee-b83c-49a4-bfcb-e289021bc1e5 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:54:29.751974 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-fde86fee-b83c-49a4-bfcb-e289021bc1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:54:29.876753 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 415/823] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:54:29 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:54:29.913374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7d4bb-50cf-4765-a04d-282d7c25848e None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:30.041241 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7d4bb-50cf-4765-a04d-282d7c25848e None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:30.079275 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2ccdd-5d71-4177-bfff-49322dcda5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:30.080035 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2ccdd-5d71-4177-bfff-49322dcda5d4 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:30.080342 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2ccdd-5d71-4177-bfff-49322dcda5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:30.080683 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2ccdd-5d71-4177-bfff-49322dcda5d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:30.095314 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2ccdd-5d71-4177-bfff-49322dcda5d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:30.096784 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2ccdd-5d71-4177-bfff-49322dcda5d4 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-d6d2ccdd-5d71-4177-bfff-49322dcda5d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:30.114297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:30.115438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:30.116425 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:30.116425 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:30.116425 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:30.116425 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:30.116425 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 409/824] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:30.122762 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde86fee-b83c-49a4-bfcb-e289021bc1e5 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:30.255501 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde86fee-b83c-49a4-bfcb-e289021bc1e5 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:30.289536 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:30.300814 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e74d75-37e2-495b-b93f-9f2003e2af96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:30.301378 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e74d75-37e2-495b-b93f-9f2003e2af96 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:30.301668 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e74d75-37e2-495b-b93f-9f2003e2af96 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:30.301958 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e74d75-37e2-495b-b93f-9f2003e2af96 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:30.302683 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e74d75-37e2-495b-b93f-9f2003e2af96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:30.302989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e74d75-37e2-495b-b93f-9f2003e2af96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:30.304494 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e74d75-37e2-495b-b93f-9f2003e2af96 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:30.318273 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 416/825] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:54:30.325853 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2ccdd-5d71-4177-bfff-49322dcda5d4 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:30.395082 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:30.464463 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2ccdd-5d71-4177-bfff-49322dcda5d4 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:30.512154 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f2a56-95cd-467a-8fa2-6d5350e4684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:30.513035 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f2a56-95cd-467a-8fa2-6d5350e4684a None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:30.513331 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f2a56-95cd-467a-8fa2-6d5350e4684a None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:30.513651 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f2a56-95cd-467a-8fa2-6d5350e4684a None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:30.514939 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f2a56-95cd-467a-8fa2-6d5350e4684a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:30.516603 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f2a56-95cd-467a-8fa2-6d5350e4684a None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:30.542595 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 410/826] 10.222.0.73 () {60 vars in 1132 bytes} [Wed Jul 27 17:54:30 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:54:33.069132 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f77aff-8d4b-4cfe-81fb-a15d57f31059 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:33.069685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f77aff-8d4b-4cfe-81fb-a15d57f31059 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:33.069685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f77aff-8d4b-4cfe-81fb-a15d57f31059 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:33.071023 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 417/827] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:54:33.077269 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bb6ef-efad-49c8-80ea-6fb5e7cf904e None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:33.077863 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bb6ef-efad-49c8-80ea-6fb5e7cf904e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:33.077956 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bb6ef-efad-49c8-80ea-6fb5e7cf904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:33.101305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-a53bb6ef-efad-49c8-80ea-6fb5e7cf904e None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:54:33.102544 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-a53bb6ef-efad-49c8-80ea-6fb5e7cf904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:54:33.173091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 411/828] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:54:33 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:54:33.203005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f77aff-8d4b-4cfe-81fb-a15d57f31059 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:33.334921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f77aff-8d4b-4cfe-81fb-a15d57f31059 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:33.386452 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b911c-1a65-47dd-8b5f-37121bc97f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:33.387316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b911c-1a65-47dd-8b5f-37121bc97f79 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:33.387696 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b911c-1a65-47dd-8b5f-37121bc97f79 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:33.388103 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b911c-1a65-47dd-8b5f-37121bc97f79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:33.401970 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b911c-1a65-47dd-8b5f-37121bc97f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-453b911c-1a65-47dd-8b5f-37121bc97f79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:54:33.407794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:33.409332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:33.410480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 418/829] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:54:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:33.419001 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bb6ef-efad-49c8-80ea-6fb5e7cf904e None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:33.470419 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:33.544969 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bb6ef-efad-49c8-80ea-6fb5e7cf904e None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:33.591306 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676dadc-a21e-447b-bab6-7f4a1954d8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:33.592959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676dadc-a21e-447b-bab6-7f4a1954d8d5 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:33.593188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676dadc-a21e-447b-bab6-7f4a1954d8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:33.593428 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676dadc-a21e-447b-bab6-7f4a1954d8d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:33.594160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676dadc-a21e-447b-bab6-7f4a1954d8d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:33.594475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676dadc-a21e-447b-bab6-7f4a1954d8d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:33.596003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676dadc-a21e-447b-bab6-7f4a1954d8d5 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:33.610565 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 412/830] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:54:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:54:33.612552 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b911c-1a65-47dd-8b5f-37121bc97f79 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:33.674298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:33.738088 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b911c-1a65-47dd-8b5f-37121bc97f79 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:33.778804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26d7d-727d-4dd8-8705-43cb051659cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:33.779477 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26d7d-727d-4dd8-8705-43cb051659cd None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:33.780311 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26d7d-727d-4dd8-8705-43cb051659cd None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:33.780611 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26d7d-727d-4dd8-8705-43cb051659cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:33.792943 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc26d7d-727d-4dd8-8705-43cb051659cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:33.794432 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc26d7d-727d-4dd8-8705-43cb051659cd None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-3fc26d7d-727d-4dd8-8705-43cb051659cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:33.810173 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:33.812250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:33.813403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:33.813403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:33.813403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:33.813403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:33.813403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 419/831] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:54:33.818066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676dadc-a21e-447b-bab6-7f4a1954d8d5 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:33.937588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:33.940655 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676dadc-a21e-447b-bab6-7f4a1954d8d5 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:33.977795 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935bd11-6424-4a05-b7e0-8584b8c85c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:33.978428 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bd11-6424-4a05-b7e0-8584b8c85c49 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:33.978745 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bd11-6424-4a05-b7e0-8584b8c85c49 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:33.979028 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bd11-6424-4a05-b7e0-8584b8c85c49 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:33.979739 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935bd11-6424-4a05-b7e0-8584b8c85c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:33.980053 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935bd11-6424-4a05-b7e0-8584b8c85c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:33.981435 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935bd11-6424-4a05-b7e0-8584b8c85c49 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:33.996610 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 413/832] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:34.003529 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26d7d-727d-4dd8-8705-43cb051659cd None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:34.124689 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:34.130350 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26d7d-727d-4dd8-8705-43cb051659cd None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:34.179635 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73941dde-bb04-455e-973b-791563018ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:34.180436 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941dde-bb04-455e-973b-791563018ade None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:34.180850 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941dde-bb04-455e-973b-791563018ade None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:34.181358 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941dde-bb04-455e-973b-791563018ade None admin] PATH_INFO: `/v3/users/placement` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:34.193315 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73941dde-bb04-455e-973b-791563018ade None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:34.195004 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73941dde-bb04-455e-973b-791563018ade None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-73941dde-bb04-455e-973b-791563018ade None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:54:34.210990 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:34.212756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:34.215064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:34.215064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:34.215064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:54:34.215064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:54:34.215064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:54:34.215064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:54:34.215064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:54:34.215064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:54:34.215064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:34.215064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:34.215064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 420/833] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:34.221836 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935bd11-6424-4a05-b7e0-8584b8c85c49 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:34.372015 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935bd11-6424-4a05-b7e0-8584b8c85c49 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:34.411834 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a3c4c-56e1-494e-bd86-262deac4e0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:34.411834 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a3c4c-56e1-494e-bd86-262deac4e0c7 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:34.412274 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a3c4c-56e1-494e-bd86-262deac4e0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:34.412405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a3c4c-56e1-494e-bd86-262deac4e0c7 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:34.413176 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a3c4c-56e1-494e-bd86-262deac4e0c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:34.413484 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a3c4c-56e1-494e-bd86-262deac4e0c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:34.415013 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a3c4c-56e1-494e-bd86-262deac4e0c7 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:34.435424 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 414/834] 10.222.0.73 () {56 vars in 1143 bytes} [Wed Jul 27 17:54:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:34.444625 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73941dde-bb04-455e-973b-791563018ade None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:34.580042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73941dde-bb04-455e-973b-791563018ade None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:34.623742 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2657db0-0f87-4e67-b7ad-e64c08a2d2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:34.624714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657db0-0f87-4e67-b7ad-e64c08a2d2f8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:34.625000 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657db0-0f87-4e67-b7ad-e64c08a2d2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:34.625281 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657db0-0f87-4e67-b7ad-e64c08a2d2f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:34.661318 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:34.713438 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2657db0-0f87-4e67-b7ad-e64c08a2d2f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:34.715011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2657db0-0f87-4e67-b7ad-e64c08a2d2f8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:34.833053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 421/835] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:54:34 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 17:54:34.839302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a3c4c-56e1-494e-bd86-262deac4e0c7 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:34.863615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:34.950811 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a3c4c-56e1-494e-bd86-262deac4e0c7 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:34.990944 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeefcc-f00f-4013-815c-1b07f5b1ea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:34.991611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeefcc-f00f-4013-815c-1b07f5b1ea7c None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:34.991922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeefcc-f00f-4013-815c-1b07f5b1ea7c None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:34.992217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeefcc-f00f-4013-815c-1b07f5b1ea7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:35.005548 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeeefcc-f00f-4013-815c-1b07f5b1ea7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:35.007189 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeeefcc-f00f-4013-815c-1b07f5b1ea7c None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-cbeeefcc-f00f-4013-815c-1b07f5b1ea7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:35.025876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:35.027250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:35.028217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:35.028217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:35.028217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:35.028217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:35.028217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 415/836] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:35.034849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2657db0-0f87-4e67-b7ad-e64c08a2d2f8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:35.122842 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:35.171113 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2657db0-0f87-4e67-b7ad-e64c08a2d2f8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:35.208216 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d57f0-30ef-4fbd-8ce2-d69a82be03b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:35.208833 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d57f0-30ef-4fbd-8ce2-d69a82be03b1 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:35.209111 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d57f0-30ef-4fbd-8ce2-d69a82be03b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:35.209381 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d57f0-30ef-4fbd-8ce2-d69a82be03b1 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:35.210066 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d57f0-30ef-4fbd-8ce2-d69a82be03b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:35.210375 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d57f0-30ef-4fbd-8ce2-d69a82be03b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:35.211776 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d57f0-30ef-4fbd-8ce2-d69a82be03b1 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:35.225064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 422/837] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:35.230663 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeefcc-f00f-4013-815c-1b07f5b1ea7c None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:35.307175 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:35.343900 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeefcc-f00f-4013-815c-1b07f5b1ea7c None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:35.379919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633dfb0-442c-410f-aaf6-ceaf1ed3c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:35.380672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633dfb0-442c-410f-aaf6-ceaf1ed3c280 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:35.381063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633dfb0-442c-410f-aaf6-ceaf1ed3c280 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:35.381429 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633dfb0-442c-410f-aaf6-ceaf1ed3c280 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:35.390383 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633dfb0-442c-410f-aaf6-ceaf1ed3c280 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:35.392103 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633dfb0-442c-410f-aaf6-ceaf1ed3c280 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-6633dfb0-442c-410f-aaf6-ceaf1ed3c280 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:54:35.407658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:35.409367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:35.410553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:54:35.410553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:54:35.410553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:54:35.410553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:54:35.410553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:54:35.410553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:54:35.410553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:35.410553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:35.410553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 416/838] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:54:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:54:35.415101 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d57f0-30ef-4fbd-8ce2-d69a82be03b1 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:35.534053 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d57f0-30ef-4fbd-8ce2-d69a82be03b1 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:35.554220 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:35.572802 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8f222-14f6-406b-8b50-fd12f588e2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:35.573341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f222-14f6-406b-8b50-fd12f588e2e0 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:35.573674 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f222-14f6-406b-8b50-fd12f588e2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:35.574094 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f222-14f6-406b-8b50-fd12f588e2e0 None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:35.574969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8f222-14f6-406b-8b50-fd12f588e2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:35.575283 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8f222-14f6-406b-8b50-fd12f588e2e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:35.577040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8f222-14f6-406b-8b50-fd12f588e2e0 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:35.590923 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 423/839] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:54:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:35.597932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633dfb0-442c-410f-aaf6-ceaf1ed3c280 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:35.710701 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633dfb0-442c-410f-aaf6-ceaf1ed3c280 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:35.741838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:35.748131 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b23f0-5718-46e4-a2d0-5e1c0dc3e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:35.748861 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b23f0-5718-46e4-a2d0-5e1c0dc3e412 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:35.749273 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b23f0-5718-46e4-a2d0-5e1c0dc3e412 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:35.749432 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b23f0-5718-46e4-a2d0-5e1c0dc3e412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:35.750218 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b23f0-5718-46e4-a2d0-5e1c0dc3e412 None admin] RBAC: Adding query filter params (role.id=af430df1b4ae42f3bc51a56f0cb42e33, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=5144a9d861f8482a8f31abc1315fe818) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:35.750558 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b23f0-5718-46e4-a2d0-5e1c0dc3e412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:35.751993 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b23f0-5718-46e4-a2d0-5e1c0dc3e412 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:35.759163 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 417/840] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:54:35 2022] GET /identity/v3/role_assignments?user.id=5144a9d861f8482a8f31abc1315fe818&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=af430df1b4ae42f3bc51a56f0cb42e33 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:38.025872 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d29f86-b227-4c80-9047-7cb727706dbe None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:38.026467 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d29f86-b227-4c80-9047-7cb727706dbe None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:38.026467 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d29f86-b227-4c80-9047-7cb727706dbe None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:38.027785 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 424/841] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:54:38.033907 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e70a5a-9aaf-4dc1-9928-ede75400c162 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:38.034368 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e70a5a-9aaf-4dc1-9928-ede75400c162 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:38.034454 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e70a5a-9aaf-4dc1-9928-ede75400c162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:38.055747 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-26e70a5a-9aaf-4dc1-9928-ede75400c162 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:54:38.057074 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-26e70a5a-9aaf-4dc1-9928-ede75400c162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:54:38.134446 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 418/842] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:54:38 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:54:38.159339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d29f86-b227-4c80-9047-7cb727706dbe None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:38.272769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d29f86-b227-4c80-9047-7cb727706dbe None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:38.313766 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615368c-87d9-4ba9-82ed-d87d7a694ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:38.314332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615368c-87d9-4ba9-82ed-d87d7a694ad3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:38.314658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615368c-87d9-4ba9-82ed-d87d7a694ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:38.314932 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615368c-87d9-4ba9-82ed-d87d7a694ad3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:38.325325 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615368c-87d9-4ba9-82ed-d87d7a694ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-b615368c-87d9-4ba9-82ed-d87d7a694ad3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:54:38.335245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:38.336571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:38.337636 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 425/843] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:54:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:38.341922 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e70a5a-9aaf-4dc1-9928-ede75400c162 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:38.452631 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e70a5a-9aaf-4dc1-9928-ede75400c162 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:38.479110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:38.491429 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f27094-3e8b-4280-98b9-dba1dadb1482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:38.492051 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f27094-3e8b-4280-98b9-dba1dadb1482 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:38.492334 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f27094-3e8b-4280-98b9-dba1dadb1482 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:38.492611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f27094-3e8b-4280-98b9-dba1dadb1482 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:38.493329 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f27094-3e8b-4280-98b9-dba1dadb1482 None admin] RBAC: Adding query filter params (name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:38.493636 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f27094-3e8b-4280-98b9-dba1dadb1482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:38.495076 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f27094-3e8b-4280-98b9-dba1dadb1482 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:38.504563 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 419/844] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:54:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:38.510816 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615368c-87d9-4ba9-82ed-d87d7a694ad3 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:38.557497 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:38.628059 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615368c-87d9-4ba9-82ed-d87d7a694ad3 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:38.666707 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e4264-0cec-4cd4-8c6c-52dbd66e3aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:38.667600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e4264-0cec-4cd4-8c6c-52dbd66e3aca None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:38.668021 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e4264-0cec-4cd4-8c6c-52dbd66e3aca None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:38.668381 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e4264-0cec-4cd4-8c6c-52dbd66e3aca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:38.679561 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e4264-0cec-4cd4-8c6c-52dbd66e3aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:38.681081 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e4264-0cec-4cd4-8c6c-52dbd66e3aca None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-932e4264-0cec-4cd4-8c6c-52dbd66e3aca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:38.695969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:38.697257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:38.698461 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:38.698461 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:38.698461 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:38.698461 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:38.704060 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 426/845] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:54:38.704226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f27094-3e8b-4280-98b9-dba1dadb1482 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:38.817253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f27094-3e8b-4280-98b9-dba1dadb1482 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:38.856162 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe3cd9-199b-40fa-b80c-092f1d2e2523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:38.856916 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe3cd9-199b-40fa-b80c-092f1d2e2523 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:38.857226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe3cd9-199b-40fa-b80c-092f1d2e2523 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:38.858086 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe3cd9-199b-40fa-b80c-092f1d2e2523 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:38.859188 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe3cd9-199b-40fa-b80c-092f1d2e2523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:38.859551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe3cd9-199b-40fa-b80c-092f1d2e2523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:38.861168 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe3cd9-199b-40fa-b80c-092f1d2e2523 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:38.874077 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 420/846] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:38.879915 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e4264-0cec-4cd4-8c6c-52dbd66e3aca None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:38.977783 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:38.989038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e4264-0cec-4cd4-8c6c-52dbd66e3aca None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:39.027920 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb44229-a08e-4f94-b64d-9a99e3da4c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:39.028569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb44229-a08e-4f94-b64d-9a99e3da4c12 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:39.028830 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb44229-a08e-4f94-b64d-9a99e3da4c12 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:39.029107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb44229-a08e-4f94-b64d-9a99e3da4c12 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:39.039608 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb44229-a08e-4f94-b64d-9a99e3da4c12 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:39.041083 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb44229-a08e-4f94-b64d-9a99e3da4c12 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-0fb44229-a08e-4f94-b64d-9a99e3da4c12 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:54:39.055164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:39.056413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:39.057831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:39.057831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:39.057831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:54:39.057831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:54:39.057831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:54:39.057831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:54:39.057831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:54:39.057831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:54:39.057831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:39.057831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:39.061270 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 427/847] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:54:39.062288 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe3cd9-199b-40fa-b80c-092f1d2e2523 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:39.117635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:39.176490 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe3cd9-199b-40fa-b80c-092f1d2e2523 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:39.212481 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23df8c-bf96-4afc-8a35-965a682f76da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:39.213135 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23df8c-bf96-4afc-8a35-965a682f76da None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:39.213421 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23df8c-bf96-4afc-8a35-965a682f76da None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:39.213741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23df8c-bf96-4afc-8a35-965a682f76da None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:39.214660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23df8c-bf96-4afc-8a35-965a682f76da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:39.214973 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23df8c-bf96-4afc-8a35-965a682f76da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:39.216499 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23df8c-bf96-4afc-8a35-965a682f76da None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:39.237186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 421/848] 10.222.0.73 () {56 vars in 1143 bytes} [Wed Jul 27 17:54:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:39.242897 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb44229-a08e-4f94-b64d-9a99e3da4c12 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:39.358852 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb44229-a08e-4f94-b64d-9a99e3da4c12 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:39.398573 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504960e-9516-416d-813b-74c5e8197e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:39.399344 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504960e-9516-416d-813b-74c5e8197e87 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:39.399635 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504960e-9516-416d-813b-74c5e8197e87 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:39.399925 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504960e-9516-416d-813b-74c5e8197e87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:39.416558 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504960e-9516-416d-813b-74c5e8197e87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:39.419214 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504960e-9516-416d-813b-74c5e8197e87 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-c504960e-9516-416d-813b-74c5e8197e87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:39.448179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:39.450770 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:39.452630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:39.452630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:39.452630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:39.452630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:39.452630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 428/849] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:39.457540 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23df8c-bf96-4afc-8a35-965a682f76da None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:39.565466 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23df8c-bf96-4afc-8a35-965a682f76da None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:39.567859 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:39.603943 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc272576-f24d-4375-bf60-a80ce92f1be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:39.604644 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc272576-f24d-4375-bf60-a80ce92f1be6 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:39.604930 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc272576-f24d-4375-bf60-a80ce92f1be6 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:39.605210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc272576-f24d-4375-bf60-a80ce92f1be6 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:39.606028 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc272576-f24d-4375-bf60-a80ce92f1be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:39.606444 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc272576-f24d-4375-bf60-a80ce92f1be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:39.608904 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc272576-f24d-4375-bf60-a80ce92f1be6 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:39.626306 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 422/850] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:39.627616 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504960e-9516-416d-813b-74c5e8197e87 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:39.630574 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:39.751382 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504960e-9516-416d-813b-74c5e8197e87 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:39.798501 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c3a0a-c71f-4dd4-b2ca-f4891b697412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:39.799188 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c3a0a-c71f-4dd4-b2ca-f4891b697412 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:39.799477 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c3a0a-c71f-4dd4-b2ca-f4891b697412 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:39.799765 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c3a0a-c71f-4dd4-b2ca-f4891b697412 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:39.810088 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c3a0a-c71f-4dd4-b2ca-f4891b697412 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:39.812744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c3a0a-c71f-4dd4-b2ca-f4891b697412 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-709c3a0a-c71f-4dd4-b2ca-f4891b697412 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:54:39.829038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:39.830022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:39.830981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:54:39.830981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:54:39.830981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:54:39.830981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:54:39.830981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:54:39.830981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:54:39.830981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:39.830981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:39.830981 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 429/851] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:54:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:39.836292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc272576-f24d-4375-bf60-a80ce92f1be6 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:39.952730 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc272576-f24d-4375-bf60-a80ce92f1be6 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:39.996128 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ed684-3c1c-41e5-9a88-ad29654ad663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:39.996757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ed684-3c1c-41e5-9a88-ad29654ad663 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:39.997115 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ed684-3c1c-41e5-9a88-ad29654ad663 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:39.997426 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ed684-3c1c-41e5-9a88-ad29654ad663 None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:39.998276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ed684-3c1c-41e5-9a88-ad29654ad663 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:39.998623 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ed684-3c1c-41e5-9a88-ad29654ad663 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:40.000058 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ed684-3c1c-41e5-9a88-ad29654ad663 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:40.013018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 423/852] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:54:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:54:40.019283 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c3a0a-c71f-4dd4-b2ca-f4891b697412 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:40.085614 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:40.133843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c3a0a-c71f-4dd4-b2ca-f4891b697412 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:40.173114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b10221-93db-4b20-9e1f-3ab1c7aeb9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:40.173782 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b10221-93db-4b20-9e1f-3ab1c7aeb9de None admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:40.174064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b10221-93db-4b20-9e1f-3ab1c7aeb9de None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:40.174341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b10221-93db-4b20-9e1f-3ab1c7aeb9de None admin] PATH_INFO: `/v3/projects/bcf65bac3a154c95b119204e594db593/users/5144a9d861f8482a8f31abc1315fe818/roles/af430df1b4ae42f3bc51a56f0cb42e33` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:40.190020 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b10221-93db-4b20-9e1f-3ab1c7aeb9de None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf65bac3a154c95b119204e594db593, user_id=5144a9d861f8482a8f31abc1315fe818, role_id=af430df1b4ae42f3bc51a56f0cb42e33)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:40.191481 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b10221-93db-4b20-9e1f-3ab1c7aeb9de None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:40.204649 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 430/853] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:54:40 2022] PUT /identity/v3/projects/bcf65bac3a154c95b119204e594db593/users/5144a9d861f8482a8f31abc1315fe818/roles/af430df1b4ae42f3bc51a56f0cb42e33 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:54:42.637700 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fad77-4a2b-400d-992a-2915478bebe0 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:42.638254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fad77-4a2b-400d-992a-2915478bebe0 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:42.638254 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fad77-4a2b-400d-992a-2915478bebe0 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:42.639786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 424/854] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:54:42.646007 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8574-3316-4eff-b737-7f591f430947 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:42.646579 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8574-3316-4eff-b737-7f591f430947 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:42.646579 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8574-3316-4eff-b737-7f591f430947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:42.667078 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-18ac8574-3316-4eff-b737-7f591f430947 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:54:42.668301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-18ac8574-3316-4eff-b737-7f591f430947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:54:42.760013 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 431/855] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:54:42 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:54:42.785558 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fad77-4a2b-400d-992a-2915478bebe0 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:42.813554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:42.895946 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fad77-4a2b-400d-992a-2915478bebe0 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:42.936123 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573d580-cfc8-48eb-b253-51cb37b002a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:42.936878 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573d580-cfc8-48eb-b253-51cb37b002a7 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:42.937203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573d580-cfc8-48eb-b253-51cb37b002a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:42.937515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573d580-cfc8-48eb-b253-51cb37b002a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:42.948995 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573d580-cfc8-48eb-b253-51cb37b002a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-6573d580-cfc8-48eb-b253-51cb37b002a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:54:42.954757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:42.955959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:42.957148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 425/856] 10.222.0.73 () {56 vars in 1102 bytes} [Wed Jul 27 17:54:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:54:42.962068 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac8574-3316-4eff-b737-7f591f430947 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:43.009217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:43.076642 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac8574-3316-4eff-b737-7f591f430947 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:43.116088 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529e422-74ec-4120-a1ad-b77f55d0757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:43.116731 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529e422-74ec-4120-a1ad-b77f55d0757d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:43.117014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529e422-74ec-4120-a1ad-b77f55d0757d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:43.117294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529e422-74ec-4120-a1ad-b77f55d0757d None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:43.118025 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529e422-74ec-4120-a1ad-b77f55d0757d None admin] RBAC: Adding query filter params (name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:43.118341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529e422-74ec-4120-a1ad-b77f55d0757d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:43.119951 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529e422-74ec-4120-a1ad-b77f55d0757d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:43.130489 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 432/857] 10.222.0.73 () {56 vars in 1103 bytes} [Wed Jul 27 17:54:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:43.137018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573d580-cfc8-48eb-b253-51cb37b002a7 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:43.233535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:43.252753 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573d580-cfc8-48eb-b253-51cb37b002a7 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:43.291665 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619adcef-4a18-4e43-8180-a9945c071583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:43.292338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619adcef-4a18-4e43-8180-a9945c071583 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:43.292662 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619adcef-4a18-4e43-8180-a9945c071583 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:43.292848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619adcef-4a18-4e43-8180-a9945c071583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:43.304684 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619adcef-4a18-4e43-8180-a9945c071583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:43.306147 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619adcef-4a18-4e43-8180-a9945c071583 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-619adcef-4a18-4e43-8180-a9945c071583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:43.322932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:43.330187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:43.331731 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:43.331731 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:43.331731 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:43.331731 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:43.331731 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 426/858] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:43.332037 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529e422-74ec-4120-a1ad-b77f55d0757d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:43.450243 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529e422-74ec-4120-a1ad-b77f55d0757d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:43.453534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:43.488788 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945b320-2d71-45d3-9e9c-c6f23ad2f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:43.489339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945b320-2d71-45d3-9e9c-c6f23ad2f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:43.489629 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945b320-2d71-45d3-9e9c-c6f23ad2f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:43.489911 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945b320-2d71-45d3-9e9c-c6f23ad2f3d9 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:43.490644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945b320-2d71-45d3-9e9c-c6f23ad2f3d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:43.490956 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945b320-2d71-45d3-9e9c-c6f23ad2f3d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:43.492355 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945b320-2d71-45d3-9e9c-c6f23ad2f3d9 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:43.505772 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 433/859] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:43.511820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619adcef-4a18-4e43-8180-a9945c071583 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:43.628519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619adcef-4a18-4e43-8180-a9945c071583 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:43.671133 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f118f-2959-402d-acb7-e3f068fa164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:43.671980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f118f-2959-402d-acb7-e3f068fa164d None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:43.672378 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f118f-2959-402d-acb7-e3f068fa164d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:43.672665 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f118f-2959-402d-acb7-e3f068fa164d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:43.676092 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:43.682788 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f118f-2959-402d-acb7-e3f068fa164d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:43.684555 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f118f-2959-402d-acb7-e3f068fa164d None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-0f0f118f-2959-402d-acb7-e3f068fa164d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:54:43.697305 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:43.698640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:43.700195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:43.700195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:43.700195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:54:43.700195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:54:43.700195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:54:43.700195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:54:43.700195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:54:43.700195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:54:43.700195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:43.700195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:43.700195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 427/860] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:43.704802 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945b320-2d71-45d3-9e9c-c6f23ad2f3d9 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:43.820912 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945b320-2d71-45d3-9e9c-c6f23ad2f3d9 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:43.862880 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e9184-1fac-4789-872a-4ed12e8b5728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:43.863509 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e9184-1fac-4789-872a-4ed12e8b5728 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:43.863798 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e9184-1fac-4789-872a-4ed12e8b5728 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:43.864077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e9184-1fac-4789-872a-4ed12e8b5728 None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:43.864891 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e9184-1fac-4789-872a-4ed12e8b5728 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:43.865195 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e9184-1fac-4789-872a-4ed12e8b5728 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:43.866643 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e9184-1fac-4789-872a-4ed12e8b5728 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:43.885077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 434/861] 10.222.0.73 () {56 vars in 1143 bytes} [Wed Jul 27 17:54:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:43.892980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f118f-2959-402d-acb7-e3f068fa164d None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:43.998680 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f118f-2959-402d-acb7-e3f068fa164d None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:44.036896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3c0d7-a39e-4531-b9d7-8d66fa454c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:44.037923 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3c0d7-a39e-4531-b9d7-8d66fa454c26 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:44.038436 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3c0d7-a39e-4531-b9d7-8d66fa454c26 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:44.038990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3c0d7-a39e-4531-b9d7-8d66fa454c26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:44.111632 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:44.124113 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3c0d7-a39e-4531-b9d7-8d66fa454c26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:44.125603 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3c0d7-a39e-4531-b9d7-8d66fa454c26 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:44.228866 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 428/862] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:54:43 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 17:54:44.235485 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e9184-1fac-4789-872a-4ed12e8b5728 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:44.263741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:44.349737 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e9184-1fac-4789-872a-4ed12e8b5728 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:44.393765 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889ab45-9e42-4a85-a614-e087ff5e5ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:44.394820 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889ab45-9e42-4a85-a614-e087ff5e5ef1 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:44.395257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889ab45-9e42-4a85-a614-e087ff5e5ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:44.395575 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889ab45-9e42-4a85-a614-e087ff5e5ef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:44.411400 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889ab45-9e42-4a85-a614-e087ff5e5ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:44.413033 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889ab45-9e42-4a85-a614-e087ff5e5ef1 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-1889ab45-9e42-4a85-a614-e087ff5e5ef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:44.435245 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:44.436316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:44.437272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:44.437272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:44.437272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:44.437272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:44.437272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 435/863] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:54:44.442945 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3c0d7-a39e-4531-b9d7-8d66fa454c26 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:44.547795 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:44.554165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3c0d7-a39e-4531-b9d7-8d66fa454c26 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:44.600183 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df0dc8-58f6-4707-9a15-76847d5f4fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:44.600917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0dc8-58f6-4707-9a15-76847d5f4fbb None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:44.601256 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0dc8-58f6-4707-9a15-76847d5f4fbb None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:44.601598 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0dc8-58f6-4707-9a15-76847d5f4fbb None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:44.602361 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df0dc8-58f6-4707-9a15-76847d5f4fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:44.602760 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df0dc8-58f6-4707-9a15-76847d5f4fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:44.604232 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df0dc8-58f6-4707-9a15-76847d5f4fbb None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:44.616852 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 429/864] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:44.622743 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889ab45-9e42-4a85-a614-e087ff5e5ef1 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:44.717424 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:44.743906 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889ab45-9e42-4a85-a614-e087ff5e5ef1 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:44.784068 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e81b3-6222-4e37-82f6-19823fda4ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:44.784752 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e81b3-6222-4e37-82f6-19823fda4ab8 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:44.785042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e81b3-6222-4e37-82f6-19823fda4ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:44.785324 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e81b3-6222-4e37-82f6-19823fda4ab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:44.792952 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e81b3-6222-4e37-82f6-19823fda4ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:44.794915 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e81b3-6222-4e37-82f6-19823fda4ab8 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-008e81b3-6222-4e37-82f6-19823fda4ab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:54:44.808412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:44.809518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:44.810682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:54:44.810682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:54:44.810682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:54:44.810682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:54:44.810682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:54:44.810682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:54:44.810682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:44.810682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:44.812447 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 436/865] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:54:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:44.818982 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df0dc8-58f6-4707-9a15-76847d5f4fbb None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:44.935939 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df0dc8-58f6-4707-9a15-76847d5f4fbb None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:44.971221 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c6b29-ee7d-4a69-9e8c-f461f3f8b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:44.971759 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6b29-ee7d-4a69-9e8c-f461f3f8b048 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:44.972039 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6b29-ee7d-4a69-9e8c-f461f3f8b048 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:44.972309 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6b29-ee7d-4a69-9e8c-f461f3f8b048 None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:44.973048 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c6b29-ee7d-4a69-9e8c-f461f3f8b048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:44.973353 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c6b29-ee7d-4a69-9e8c-f461f3f8b048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:44.974798 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c6b29-ee7d-4a69-9e8c-f461f3f8b048 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:44.988950 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 430/866] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:54:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:54:44.995391 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e81b3-6222-4e37-82f6-19823fda4ab8 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:45.113033 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e81b3-6222-4e37-82f6-19823fda4ab8 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:45.157238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc43c5-fb34-49df-bc9e-0bb3c1d5fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:45.157868 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc43c5-fb34-49df-bc9e-0bb3c1d5fb43 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:45.158149 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc43c5-fb34-49df-bc9e-0bb3c1d5fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:45.158450 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc43c5-fb34-49df-bc9e-0bb3c1d5fb43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:45.159273 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc43c5-fb34-49df-bc9e-0bb3c1d5fb43 None admin] RBAC: Adding query filter params (role.id=af430df1b4ae42f3bc51a56f0cb42e33, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=5144a9d861f8482a8f31abc1315fe818) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:45.159584 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc43c5-fb34-49df-bc9e-0bb3c1d5fb43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:45.161392 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc43c5-fb34-49df-bc9e-0bb3c1d5fb43 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:45.163690 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:45.170247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 437/867] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:54:44 2022] GET /identity/v3/role_assignments?user.id=5144a9d861f8482a8f31abc1315fe818&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=af430df1b4ae42f3bc51a56f0cb42e33 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:47.820239 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ce95f-c4ab-423d-9ce5-10fdc001b999 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:47.820870 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ce95f-c4ab-423d-9ce5-10fdc001b999 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:47.820870 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ce95f-c4ab-423d-9ce5-10fdc001b999 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:47.822379 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 431/868] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:54:47.828505 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6063c7a-c346-453c-a8f7-02f70b6c5e12 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:47.829000 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6063c7a-c346-453c-a8f7-02f70b6c5e12 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:47.829099 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6063c7a-c346-453c-a8f7-02f70b6c5e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:47.850298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-c6063c7a-c346-453c-a8f7-02f70b6c5e12 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:54:47.851996 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-c6063c7a-c346-453c-a8f7-02f70b6c5e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:54:47.931630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 438/869] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:54:47 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:54:47.958935 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ce95f-c4ab-423d-9ce5-10fdc001b999 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:47.983568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:48.085371 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ce95f-c4ab-423d-9ce5-10fdc001b999 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:48.121741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14daa24-b2ce-4115-a131-db89f4db3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:48.122379 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14daa24-b2ce-4115-a131-db89f4db3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:48.122732 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14daa24-b2ce-4115-a131-db89f4db3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:48.123013 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14daa24-b2ce-4115-a131-db89f4db3ee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:48.133358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14daa24-b2ce-4115-a131-db89f4db3ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-d14daa24-b2ce-4115-a131-db89f4db3ee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:54:48.139786 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:48.140984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:48.142127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 432/870] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:54:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:54:48.147166 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6063c7a-c346-453c-a8f7-02f70b6c5e12 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:48.258779 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6063c7a-c346-453c-a8f7-02f70b6c5e12 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:48.290898 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:48.301029 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3e71-33ea-4d59-9451-718d183acc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:48.301654 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3e71-33ea-4d59-9451-718d183acc3b None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:48.301979 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3e71-33ea-4d59-9451-718d183acc3b None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:48.302232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3e71-33ea-4d59-9451-718d183acc3b None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:48.302969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d3e71-33ea-4d59-9451-718d183acc3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:48.303308 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d3e71-33ea-4d59-9451-718d183acc3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:48.304648 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d3e71-33ea-4d59-9451-718d183acc3b None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:48.313630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 439/871] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:54:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:48.319580 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14daa24-b2ce-4115-a131-db89f4db3ee5 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:48.416046 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:48.447164 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14daa24-b2ce-4115-a131-db89f4db3ee5 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:48.491567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc4158-b1b7-4235-a363-a3c8e6c96291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:48.492378 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc4158-b1b7-4235-a363-a3c8e6c96291 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:48.492652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc4158-b1b7-4235-a363-a3c8e6c96291 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:48.492943 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc4158-b1b7-4235-a363-a3c8e6c96291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:48.504370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc4158-b1b7-4235-a363-a3c8e6c96291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:48.505982 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc4158-b1b7-4235-a363-a3c8e6c96291 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-c1dc4158-b1b7-4235-a363-a3c8e6c96291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:48.522110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:48.523302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:48.524217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:48.524217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:48.524217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:48.524217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:48.524217 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 433/872] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 17:54:48.534168 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3e71-33ea-4d59-9451-718d183acc3b None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:48.644387 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3e71-33ea-4d59-9451-718d183acc3b None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:48.681168 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cd3aa-319d-4fb6-87a0-82ae7964fa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:48.681800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cd3aa-319d-4fb6-87a0-82ae7964fa7f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:48.682087 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cd3aa-319d-4fb6-87a0-82ae7964fa7f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:48.682390 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cd3aa-319d-4fb6-87a0-82ae7964fa7f None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:48.683215 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cd3aa-319d-4fb6-87a0-82ae7964fa7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:48.683534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cd3aa-319d-4fb6-87a0-82ae7964fa7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:48.685042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cd3aa-319d-4fb6-87a0-82ae7964fa7f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:48.700241 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 440/873] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:48.706371 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc4158-b1b7-4235-a363-a3c8e6c96291 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:48.821525 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc4158-b1b7-4235-a363-a3c8e6c96291 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:48.850958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:48.859906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bebee-73f6-4d4c-ac37-5344a0c8744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:48.860560 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bebee-73f6-4d4c-ac37-5344a0c8744d None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:48.861055 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bebee-73f6-4d4c-ac37-5344a0c8744d None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:48.861284 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bebee-73f6-4d4c-ac37-5344a0c8744d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:48.869489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bebee-73f6-4d4c-ac37-5344a0c8744d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:48.870984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bebee-73f6-4d4c-ac37-5344a0c8744d None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-871bebee-73f6-4d4c-ac37-5344a0c8744d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:54:48.884338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:48.885549 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:48.886772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:48.886772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:48.886772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:54:48.886772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:54:48.886772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:54:48.886772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:54:48.886772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:54:48.886772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:54:48.886772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:48.886772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:48.886772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 434/874] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:48.893039 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cd3aa-319d-4fb6-87a0-82ae7964fa7f None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:48.947996 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:49.010409 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cd3aa-319d-4fb6-87a0-82ae7964fa7f None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:49.050228 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816d87d-6c2a-41d4-bd6e-92da7a583550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:49.050948 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816d87d-6c2a-41d4-bd6e-92da7a583550 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:49.051272 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816d87d-6c2a-41d4-bd6e-92da7a583550 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:49.051616 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816d87d-6c2a-41d4-bd6e-92da7a583550 None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:49.052547 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816d87d-6c2a-41d4-bd6e-92da7a583550 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:49.052936 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816d87d-6c2a-41d4-bd6e-92da7a583550 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:49.054680 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816d87d-6c2a-41d4-bd6e-92da7a583550 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:49.075357 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 441/875] 10.222.0.73 () {56 vars in 1143 bytes} [Wed Jul 27 17:54:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:49.082307 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bebee-73f6-4d4c-ac37-5344a0c8744d None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:49.200387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bebee-73f6-4d4c-ac37-5344a0c8744d None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:49.239927 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5ccf3-0932-4dee-9656-6a28ea754753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:49.240550 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5ccf3-0932-4dee-9656-6a28ea754753 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:49.240835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5ccf3-0932-4dee-9656-6a28ea754753 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:49.241116 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5ccf3-0932-4dee-9656-6a28ea754753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:49.303932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:49.317764 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5ccf3-0932-4dee-9656-6a28ea754753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:49.319542 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5ccf3-0932-4dee-9656-6a28ea754753 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:49.432086 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 435/876] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:54:49 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 17:54:49.439155 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816d87d-6c2a-41d4-bd6e-92da7a583550 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:49.554322 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816d87d-6c2a-41d4-bd6e-92da7a583550 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:49.565123 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:49.593085 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a8b18-950a-424c-ba08-61fd94324d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:49.593747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a8b18-950a-424c-ba08-61fd94324d29 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:49.594107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a8b18-950a-424c-ba08-61fd94324d29 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:49.594311 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a8b18-950a-424c-ba08-61fd94324d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:49.605478 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a8b18-950a-424c-ba08-61fd94324d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:49.607626 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a8b18-950a-424c-ba08-61fd94324d29 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-525a8b18-950a-424c-ba08-61fd94324d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:49.625255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:49.626465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:49.627584 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:49.627584 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:49.627584 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:49.627584 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:49.627584 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 442/877] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:49.632936 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5ccf3-0932-4dee-9656-6a28ea754753 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:49.725037 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:49.738404 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5ccf3-0932-4dee-9656-6a28ea754753 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:49.777725 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a4f14-ff5b-4cf0-9441-ca29385e0287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:49.778359 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a4f14-ff5b-4cf0-9441-ca29385e0287 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:49.779214 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a4f14-ff5b-4cf0-9441-ca29385e0287 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:49.779507 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a4f14-ff5b-4cf0-9441-ca29385e0287 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:49.780396 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a4f14-ff5b-4cf0-9441-ca29385e0287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:49.780720 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a4f14-ff5b-4cf0-9441-ca29385e0287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:49.782156 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a4f14-ff5b-4cf0-9441-ca29385e0287 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:49.800330 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 436/878] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:49.801487 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a8b18-950a-424c-ba08-61fd94324d29 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:49.907428 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a8b18-950a-424c-ba08-61fd94324d29 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:49.945984 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18931686-5408-4e80-b609-c95035faec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:49.946708 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18931686-5408-4e80-b609-c95035faec5d None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:49.946997 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18931686-5408-4e80-b609-c95035faec5d None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:49.947274 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18931686-5408-4e80-b609-c95035faec5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:49.954694 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18931686-5408-4e80-b609-c95035faec5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:49.956132 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18931686-5408-4e80-b609-c95035faec5d None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-18931686-5408-4e80-b609-c95035faec5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:54:49.968035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:49.969190 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:49.970301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:54:49.970301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:54:49.970301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:54:49.970301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:54:49.970301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:54:49.970301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:54:49.970301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:49.970301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:49.970301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 443/879] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:54:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:49.976860 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a4f14-ff5b-4cf0-9441-ca29385e0287 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:50.083933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a4f14-ff5b-4cf0-9441-ca29385e0287 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:50.124638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982a144-7a92-4200-a750-63b4161394ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:50.125268 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a144-7a92-4200-a750-63b4161394ca None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:50.125547 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a144-7a92-4200-a750-63b4161394ca None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:50.125816 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a144-7a92-4200-a750-63b4161394ca None admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:50.126596 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982a144-7a92-4200-a750-63b4161394ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:50.126905 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982a144-7a92-4200-a750-63b4161394ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:50.128320 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982a144-7a92-4200-a750-63b4161394ca None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:50.140759 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 437/880] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:50.147000 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18931686-5408-4e80-b609-c95035faec5d None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:50.171518 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:50.249871 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18931686-5408-4e80-b609-c95035faec5d None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:50.282847 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e316d8-cb6f-4495-9806-23b500ef387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:50.283468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e316d8-cb6f-4495-9806-23b500ef387e None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:50.283754 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e316d8-cb6f-4495-9806-23b500ef387e None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:50.284034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e316d8-cb6f-4495-9806-23b500ef387e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:50.284820 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e316d8-cb6f-4495-9806-23b500ef387e None admin] RBAC: Adding query filter params (role.id=d6d0c56d1054455c813546a2c761a7d0, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=5144a9d861f8482a8f31abc1315fe818) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:50.285129 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e316d8-cb6f-4495-9806-23b500ef387e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:50.286574 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e316d8-cb6f-4495-9806-23b500ef387e None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:50.292225 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 444/881] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:54:50 2022] GET /identity/v3/role_assignments?user.id=5144a9d861f8482a8f31abc1315fe818&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 17:54:52.561241 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becb403-3f28-43b4-8c60-ff23339e4f6c None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:52.561802 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becb403-3f28-43b4-8c60-ff23339e4f6c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:52.561802 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becb403-3f28-43b4-8c60-ff23339e4f6c None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:52.563184 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 438/882] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:54:52.568450 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece83429-e036-4a56-8deb-cd7d1dfa5900 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:52.568864 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece83429-e036-4a56-8deb-cd7d1dfa5900 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:52.568996 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece83429-e036-4a56-8deb-cd7d1dfa5900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:52.586756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-ece83429-e036-4a56-8deb-cd7d1dfa5900 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:54:52.587941 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-ece83429-e036-4a56-8deb-cd7d1dfa5900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:54:52.662925 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 445/883] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:54:52 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 17:54:52.687478 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becb403-3f28-43b4-8c60-ff23339e4f6c None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:52.698116 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:52.790804 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becb403-3f28-43b4-8c60-ff23339e4f6c None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:52.824547 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddee53d-49af-4a7a-a6d1-3610ca4ca6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:52.825182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee53d-49af-4a7a-a6d1-3610ca4ca6e1 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:52.825520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee53d-49af-4a7a-a6d1-3610ca4ca6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:52.825790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee53d-49af-4a7a-a6d1-3610ca4ca6e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:52.835611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddee53d-49af-4a7a-a6d1-3610ca4ca6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-cddee53d-49af-4a7a-a6d1-3610ca4ca6e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:54:52.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:52.842066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:52.843340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 439/884] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:54:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:52.848183 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece83429-e036-4a56-8deb-cd7d1dfa5900 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:52.864235 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:52.947527 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece83429-e036-4a56-8deb-cd7d1dfa5900 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:52.984792 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadf49c-ec7f-4aae-a10e-6c8123d413f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:52.985417 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadf49c-ec7f-4aae-a10e-6c8123d413f5 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:52.985703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadf49c-ec7f-4aae-a10e-6c8123d413f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:52.985980 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadf49c-ec7f-4aae-a10e-6c8123d413f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:52.986796 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadf49c-ec7f-4aae-a10e-6c8123d413f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:52.987103 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadf49c-ec7f-4aae-a10e-6c8123d413f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:52.988472 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadf49c-ec7f-4aae-a10e-6c8123d413f5 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:52.996645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 446/885] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:54:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:53.002861 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddee53d-49af-4a7a-a6d1-3610ca4ca6e1 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:53.072069 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:53.104926 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddee53d-49af-4a7a-a6d1-3610ca4ca6e1 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:53.138534 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df38e14-0823-4e4e-8075-5fa80b39c3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:53.139346 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df38e14-0823-4e4e-8075-5fa80b39c3a2 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:53.139627 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df38e14-0823-4e4e-8075-5fa80b39c3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:53.139907 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df38e14-0823-4e4e-8075-5fa80b39c3a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:53.150368 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df38e14-0823-4e4e-8075-5fa80b39c3a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:53.151849 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df38e14-0823-4e4e-8075-5fa80b39c3a2 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-1df38e14-0823-4e4e-8075-5fa80b39c3a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:53.165551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:53.166752 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:53.167677 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:53.167677 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:53.167677 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:53.167677 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:53.167677 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 440/886] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:53.173165 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadf49c-ec7f-4aae-a10e-6c8123d413f5 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:53.248531 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:53.271131 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadf49c-ec7f-4aae-a10e-6c8123d413f5 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:53.305046 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b01c5a-b3f6-46fa-bf5e-22efd67179ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:53.305655 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b01c5a-b3f6-46fa-bf5e-22efd67179ba None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:53.305931 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b01c5a-b3f6-46fa-bf5e-22efd67179ba None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:53.306202 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b01c5a-b3f6-46fa-bf5e-22efd67179ba None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:53.306909 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b01c5a-b3f6-46fa-bf5e-22efd67179ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:53.307217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b01c5a-b3f6-46fa-bf5e-22efd67179ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:53.308557 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b01c5a-b3f6-46fa-bf5e-22efd67179ba None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:53.319945 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 447/887] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:53.325771 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df38e14-0823-4e4e-8075-5fa80b39c3a2 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:53.437005 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df38e14-0823-4e4e-8075-5fa80b39c3a2 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:53.461176 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:53.476588 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6970790-c72b-412b-a484-fa87bbea4651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:53.477222 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6970790-c72b-412b-a484-fa87bbea4651 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:53.477503 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6970790-c72b-412b-a484-fa87bbea4651 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:53.477777 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6970790-c72b-412b-a484-fa87bbea4651 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:53.486051 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6970790-c72b-412b-a484-fa87bbea4651 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:53.487499 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6970790-c72b-412b-a484-fa87bbea4651 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-e6970790-c72b-412b-a484-fa87bbea4651 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:54:53.498327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:53.499449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:53.500445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:53.500445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:53.500445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:54:53.500445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:54:53.500445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:54:53.500445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:54:53.500445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:54:53.500445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:54:53.500445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:53.500445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:53.500445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 441/888] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:53.505365 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b01c5a-b3f6-46fa-bf5e-22efd67179ba None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:53.603892 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b01c5a-b3f6-46fa-bf5e-22efd67179ba None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:53.639198 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59eacb-5a3e-4b87-8656-6da492588828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:53.639870 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59eacb-5a3e-4b87-8656-6da492588828 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:53.640147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59eacb-5a3e-4b87-8656-6da492588828 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:53.640415 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59eacb-5a3e-4b87-8656-6da492588828 None admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:53.641203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59eacb-5a3e-4b87-8656-6da492588828 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:53.641505 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59eacb-5a3e-4b87-8656-6da492588828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:53.642943 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59eacb-5a3e-4b87-8656-6da492588828 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:53.645539 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:53.661278 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 448/889] 10.222.0.73 () {56 vars in 1143 bytes} [Wed Jul 27 17:54:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:53.666972 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6970790-c72b-412b-a484-fa87bbea4651 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:53.765868 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6970790-c72b-412b-a484-fa87bbea4651 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:53.800267 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192edecf-4a5b-4ebc-8f61-931375cf5942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:53.800910 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192edecf-4a5b-4ebc-8f61-931375cf5942 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:53.801195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192edecf-4a5b-4ebc-8f61-931375cf5942 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:53.801477 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192edecf-4a5b-4ebc-8f61-931375cf5942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:53.812000 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192edecf-4a5b-4ebc-8f61-931375cf5942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:53.813434 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192edecf-4a5b-4ebc-8f61-931375cf5942 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-192edecf-4a5b-4ebc-8f61-931375cf5942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:53.827812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:53.828865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:53.829798 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:53.829798 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:53.829798 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:53.829798 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:53.829798 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 442/890] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:53.834695 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59eacb-5a3e-4b87-8656-6da492588828 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:53.930976 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59eacb-5a3e-4b87-8656-6da492588828 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:53.963775 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052a98f-93e4-4928-b11c-e612181ba7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:53.964388 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052a98f-93e4-4928-b11c-e612181ba7f0 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:53.964669 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052a98f-93e4-4928-b11c-e612181ba7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:53.964945 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052a98f-93e4-4928-b11c-e612181ba7f0 None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:53.965633 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052a98f-93e4-4928-b11c-e612181ba7f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:53.965939 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052a98f-93e4-4928-b11c-e612181ba7f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:53.967544 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052a98f-93e4-4928-b11c-e612181ba7f0 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:53.978653 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 449/891] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:53.984498 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192edecf-4a5b-4ebc-8f61-931375cf5942 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:54.016033 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:54.084800 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192edecf-4a5b-4ebc-8f61-931375cf5942 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:54.118747 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290949cc-1185-4068-9ea8-6a61d5660812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:54.119388 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290949cc-1185-4068-9ea8-6a61d5660812 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:54.119726 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290949cc-1185-4068-9ea8-6a61d5660812 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:54.119951 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290949cc-1185-4068-9ea8-6a61d5660812 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:54.129326 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290949cc-1185-4068-9ea8-6a61d5660812 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:54.130799 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290949cc-1185-4068-9ea8-6a61d5660812 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-290949cc-1185-4068-9ea8-6a61d5660812 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:54:54.141976 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:54.143052 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:54.144018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:54:54.144018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:54:54.144018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:54:54.144018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:54:54.144018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:54:54.144018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:54:54.144018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:54.144018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:54.144018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 443/892] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:54:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:54.149000 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052a98f-93e4-4928-b11c-e612181ba7f0 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:54.204761 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:54.249705 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052a98f-93e4-4928-b11c-e612181ba7f0 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:54.282683 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dc26c-1784-4db4-8c13-36e0554868df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:54.283250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc26c-1784-4db4-8c13-36e0554868df None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:54.283538 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc26c-1784-4db4-8c13-36e0554868df None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:54.283820 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc26c-1784-4db4-8c13-36e0554868df None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:54.284599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dc26c-1784-4db4-8c13-36e0554868df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:54.284912 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dc26c-1784-4db4-8c13-36e0554868df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:54.286344 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dc26c-1784-4db4-8c13-36e0554868df None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:54.298848 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 450/893] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:54.304896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290949cc-1185-4068-9ea8-6a61d5660812 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:54.397738 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:54.411618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290949cc-1185-4068-9ea8-6a61d5660812 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:54.447984 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0293d35-abf4-4b9c-aebc-6bc728f70302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:54.448650 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0293d35-abf4-4b9c-aebc-6bc728f70302 None admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:54.448936 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0293d35-abf4-4b9c-aebc-6bc728f70302 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:54.449216 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0293d35-abf4-4b9c-aebc-6bc728f70302 None admin] PATH_INFO: `/v3/projects/bcf65bac3a154c95b119204e594db593/users/5144a9d861f8482a8f31abc1315fe818/roles/d6d0c56d1054455c813546a2c761a7d0` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:54.451867 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0293d35-abf4-4b9c-aebc-6bc728f70302 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf65bac3a154c95b119204e594db593, user_id=5144a9d861f8482a8f31abc1315fe818, role_id=d6d0c56d1054455c813546a2c761a7d0)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:54.453291 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0293d35-abf4-4b9c-aebc-6bc728f70302 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:54.465808 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 444/894] 10.222.0.73 () {58 vars in 1439 bytes} [Wed Jul 27 17:54:54 2022] PUT /identity/v3/projects/bcf65bac3a154c95b119204e594db593/users/5144a9d861f8482a8f31abc1315fe818/roles/d6d0c56d1054455c813546a2c761a7d0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 17:54:56.687353 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d49d0-a034-4034-b669-b1cc553ea45a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:56.687878 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d49d0-a034-4034-b669-b1cc553ea45a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:56.687878 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d49d0-a034-4034-b669-b1cc553ea45a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:56.689236 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 451/895] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:54:56.694441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566c16e-a8ca-4566-bc88-c5983c42587b None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:56.694891 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566c16e-a8ca-4566-bc88-c5983c42587b None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:56.695046 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566c16e-a8ca-4566-bc88-c5983c42587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:56.713297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-b566c16e-a8ca-4566-bc88-c5983c42587b None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:54:56.714548 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-b566c16e-a8ca-4566-bc88-c5983c42587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:54:56.783021 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 445/896] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:54:56 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:54:56.807602 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d49d0-a034-4034-b669-b1cc553ea45a None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:56.909168 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d49d0-a034-4034-b669-b1cc553ea45a None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:56.924161 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:56.945589 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9641e1-a819-4533-be3e-7c9b06b0c028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:56.946148 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9641e1-a819-4533-be3e-7c9b06b0c028 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:56.946431 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9641e1-a819-4533-be3e-7c9b06b0c028 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:56.946736 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9641e1-a819-4533-be3e-7c9b06b0c028 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:56.956887 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9641e1-a819-4533-be3e-7c9b06b0c028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-0a9641e1-a819-4533-be3e-7c9b06b0c028 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 17:54:56.961729 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:56.962855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:56.964040 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 452/897] 10.222.0.73 () {56 vars in 1096 bytes} [Wed Jul 27 17:54:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:56.969601 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566c16e-a8ca-4566-bc88-c5983c42587b None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:57.049165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:57.068290 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566c16e-a8ca-4566-bc88-c5983c42587b None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:57.101525 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06422f23-fd03-4589-80e2-d32d036e9681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:57.102150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06422f23-fd03-4589-80e2-d32d036e9681 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:57.102426 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06422f23-fd03-4589-80e2-d32d036e9681 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:57.102735 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06422f23-fd03-4589-80e2-d32d036e9681 None admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:57.103459 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06422f23-fd03-4589-80e2-d32d036e9681 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:57.103768 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06422f23-fd03-4589-80e2-d32d036e9681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:57.105128 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06422f23-fd03-4589-80e2-d32d036e9681 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:57.113711 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 446/898] 10.222.0.73 () {56 vars in 1099 bytes} [Wed Jul 27 17:54:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:57.119412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9641e1-a819-4533-be3e-7c9b06b0c028 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:57.216045 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9641e1-a819-4533-be3e-7c9b06b0c028 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:57.248742 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256d71e-e43c-4fec-821e-c36d541b2ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:57.249367 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d71e-e43c-4fec-821e-c36d541b2ce3 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:57.249646 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d71e-e43c-4fec-821e-c36d541b2ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:57.249919 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d71e-e43c-4fec-821e-c36d541b2ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:57.260250 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256d71e-e43c-4fec-821e-c36d541b2ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:57.261685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256d71e-e43c-4fec-821e-c36d541b2ce3 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-8256d71e-e43c-4fec-821e-c36d541b2ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:57.275703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:57.276764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:57.277873 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:57.277873 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:57.277873 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:57.277873 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:57.277873 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 453/899] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:57.283350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06422f23-fd03-4589-80e2-d32d036e9681 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:57.380667 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06422f23-fd03-4589-80e2-d32d036e9681 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:57.419245 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30610cbf-4450-44ec-b152-52981807c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:57.420121 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30610cbf-4450-44ec-b152-52981807c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:57.420475 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30610cbf-4450-44ec-b152-52981807c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:57.420891 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30610cbf-4450-44ec-b152-52981807c2d5 None admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:57.421705 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30610cbf-4450-44ec-b152-52981807c2d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:57.422095 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30610cbf-4450-44ec-b152-52981807c2d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:57.423750 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30610cbf-4450-44ec-b152-52981807c2d5 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:57.437371 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 447/900] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:57.443447 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256d71e-e43c-4fec-821e-c36d541b2ce3 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:57.475391 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:57.545392 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256d71e-e43c-4fec-821e-c36d541b2ce3 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:57.577479 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d3c8a-65c8-4b23-af18-f73d0d8a5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:57.578105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d3c8a-65c8-4b23-af18-f73d0d8a5a61 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:57.578384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d3c8a-65c8-4b23-af18-f73d0d8a5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:57.578682 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d3c8a-65c8-4b23-af18-f73d0d8a5a61 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:57.585848 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d3c8a-65c8-4b23-af18-f73d0d8a5a61 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:57.587299 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d3c8a-65c8-4b23-af18-f73d0d8a5a61 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-583d3c8a-65c8-4b23-af18-f73d0d8a5a61 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 17:54:57.598924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:57.600118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:57.601858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:57.601858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:57.601858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 17:54:57.601858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 17:54:57.601858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 17:54:57.601858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 17:54:57.601858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 17:54:57.601858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 17:54:57.601858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 17:54:57.601858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:54:57.601858 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 454/901] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:57.605894 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30610cbf-4450-44ec-b152-52981807c2d5 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:57.609947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:57.712774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30610cbf-4450-44ec-b152-52981807c2d5 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:57.746340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd174a-cc64-4bfb-ab46-c7ebaa1036c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:57.746991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd174a-cc64-4bfb-ab46-c7ebaa1036c0 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:57.747274 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd174a-cc64-4bfb-ab46-c7ebaa1036c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:57.748066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd174a-cc64-4bfb-ab46-c7ebaa1036c0 None admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:57.749106 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd174a-cc64-4bfb-ab46-c7ebaa1036c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:57.749418 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd174a-cc64-4bfb-ab46-c7ebaa1036c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:57.750859 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd174a-cc64-4bfb-ab46-c7ebaa1036c0 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:57.768608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 448/902] 10.222.0.73 () {56 vars in 1143 bytes} [Wed Jul 27 17:54:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:57.774581 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d3c8a-65c8-4b23-af18-f73d0d8a5a61 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:57.858523 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:57.874441 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d3c8a-65c8-4b23-af18-f73d0d8a5a61 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:57.908041 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593a508-35fd-4c92-b33d-3f53ad369a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:57.908647 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593a508-35fd-4c92-b33d-3f53ad369a3a None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:57.908936 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593a508-35fd-4c92-b33d-3f53ad369a3a None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:57.909217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593a508-35fd-4c92-b33d-3f53ad369a3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:57.975488 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593a508-35fd-4c92-b33d-3f53ad369a3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:57.977160 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593a508-35fd-4c92-b33d-3f53ad369a3a None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:58.060954 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:58.076724 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 455/903] 10.222.0.73 () {58 vars in 1282 bytes} [Wed Jul 27 17:54:57 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 17:54:58.082819 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd174a-cc64-4bfb-ab46-c7ebaa1036c0 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:58.144321 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:58.181701 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd174a-cc64-4bfb-ab46-c7ebaa1036c0 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:58.214966 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db2e88-8ac3-43a7-8636-b75649f9a5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:58.215600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db2e88-8ac3-43a7-8636-b75649f9a5e5 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:58.215871 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db2e88-8ac3-43a7-8636-b75649f9a5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:58.216140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db2e88-8ac3-43a7-8636-b75649f9a5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:58.226589 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db2e88-8ac3-43a7-8636-b75649f9a5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:58.228030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db2e88-8ac3-43a7-8636-b75649f9a5e5 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-90db2e88-8ac3-43a7-8636-b75649f9a5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 17:54:58.241848 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:58.242947 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:58.244236 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 17:54:58.244236 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 17:54:58.244236 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 17:54:58.244236 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:58.244236 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 449/904] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:58.249180 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593a508-35fd-4c92-b33d-3f53ad369a3a None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:58.346481 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593a508-35fd-4c92-b33d-3f53ad369a3a None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:58.379525 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ca23b-3531-404a-ab67-916682e340de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:58.380136 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca23b-3531-404a-ab67-916682e340de None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:58.380419 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca23b-3531-404a-ab67-916682e340de None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:58.380697 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca23b-3531-404a-ab67-916682e340de None admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:58.381386 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ca23b-3531-404a-ab67-916682e340de None admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:58.381685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ca23b-3531-404a-ab67-916682e340de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:58.383097 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ca23b-3531-404a-ab67-916682e340de None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:58.396187 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 456/905] 10.222.0.73 () {56 vars in 1109 bytes} [Wed Jul 27 17:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:58.402256 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db2e88-8ac3-43a7-8636-b75649f9a5e5 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:58.501643 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db2e88-8ac3-43a7-8636-b75649f9a5e5 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:58.518147 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:58.538400 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bb39c-229d-4f0a-a846-f93d992ce72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:58.539099 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bb39c-229d-4f0a-a846-f93d992ce72f None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:58.539352 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bb39c-229d-4f0a-a846-f93d992ce72f None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:58.539627 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bb39c-229d-4f0a-a846-f93d992ce72f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:58.546277 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bb39c-229d-4f0a-a846-f93d992ce72f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:58.547755 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bb39c-229d-4f0a-a846-f93d992ce72f None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application [None req-968bb39c-229d-4f0a-a846-f93d992ce72f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 17:54:58.558818 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application with Lock( Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:54:58.559917 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:54:58.561681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 17:54:58.561681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 17:54:58.561681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 17:54:58.561681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 17:54:58.561681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 17:54:58.561681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 17:54:58.561681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 17:54:58.561681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: ERROR keystone.server.flask.application Jul 27 17:54:58.561681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 450/906] 10.222.0.73 () {56 vars in 1111 bytes} [Wed Jul 27 17:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:54:58.566638 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ca23b-3531-404a-ab67-916682e340de None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:58.613568 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:54:58.669031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ca23b-3531-404a-ab67-916682e340de None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:58.703416 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb3b98-1a23-467c-ab87-f902dcffe3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:58.704023 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb3b98-1a23-467c-ab87-f902dcffe3fb None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:58.704308 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb3b98-1a23-467c-ab87-f902dcffe3fb None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:58.704587 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb3b98-1a23-467c-ab87-f902dcffe3fb None admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:58.705328 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb3b98-1a23-467c-ab87-f902dcffe3fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:58.705645 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb3b98-1a23-467c-ab87-f902dcffe3fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:58.707107 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb3b98-1a23-467c-ab87-f902dcffe3fb None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:58.718895 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 457/907] 10.222.0.73 () {56 vars in 1148 bytes} [Wed Jul 27 17:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:54:58.725118 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bb39c-229d-4f0a-a846-f93d992ce72f None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:54:58.822377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bb39c-229d-4f0a-a846-f93d992ce72f None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:54:58.854904 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145b5d4-5616-4efb-a968-cc8363376548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:54:58.855619 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b5d4-5616-4efb-a968-cc8363376548 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:54:58.855789 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b5d4-5616-4efb-a968-cc8363376548 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:54:58.856062 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b5d4-5616-4efb-a968-cc8363376548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:54:58.857611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145b5d4-5616-4efb-a968-cc8363376548 None admin] RBAC: Adding query filter params (role.id=d6d0c56d1054455c813546a2c761a7d0, scope.project.id=bcf65bac3a154c95b119204e594db593, user.id=5144a9d861f8482a8f31abc1315fe818) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:54:58.857840 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145b5d4-5616-4efb-a968-cc8363376548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:54:58.859964 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145b5d4-5616-4efb-a968-cc8363376548 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:54:58.865927 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 451/908] 10.222.0.73 () {56 vars in 1374 bytes} [Wed Jul 27 17:54:58 2022] GET /identity/v3/role_assignments?user.id=5144a9d861f8482a8f31abc1315fe818&scope.project.id=bcf65bac3a154c95b119204e594db593&role.id=d6d0c56d1054455c813546a2c761a7d0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:55:01.128871 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668603c-54d2-4375-b319-09c11ce4283a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:01.129408 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668603c-54d2-4375-b319-09c11ce4283a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:01.129408 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668603c-54d2-4375-b319-09c11ce4283a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:01.130788 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 458/909] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:55:01.135974 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a101-3399-4306-a22e-111315e1f957 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:01.136416 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a101-3399-4306-a22e-111315e1f957 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:01.136535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a101-3399-4306-a22e-111315e1f957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:01.156864 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-2628a101-3399-4306-a22e-111315e1f957 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:55:01.158078 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-2628a101-3399-4306-a22e-111315e1f957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:55:01.190763 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:55:01.228991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 452/910] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:55:01 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:55:01.252555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668603c-54d2-4375-b319-09c11ce4283a None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:55:01.354631 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668603c-54d2-4375-b319-09c11ce4283a None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:55:01.363067 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:55:01.391334 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba69bd-a43a-49cd-a828-bcf11da7e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:55:01.391900 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba69bd-a43a-49cd-a828-bcf11da7e53f None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:01.392191 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba69bd-a43a-49cd-a828-bcf11da7e53f None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:01.392473 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba69bd-a43a-49cd-a828-bcf11da7e53f None admin] PATH_INFO: `/v3/services/placement` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:01.393102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba69bd-a43a-49cd-a828-bcf11da7e53f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:55:01.394483 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba69bd-a43a-49cd-a828-bcf11da7e53f None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-a9ba69bd-a43a-49cd-a828-bcf11da7e53f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:55:01.404849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:55:01.412077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:55:01.412989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 459/911] 10.222.0.73 () {56 vars in 1117 bytes} [Wed Jul 27 17:55:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:55:01.413803 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628a101-3399-4306-a22e-111315e1f957 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:55:01.520464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628a101-3399-4306-a22e-111315e1f957 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:55:01.554789 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e7488-2e20-4f26-b02d-cba37e49cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:55:01.555400 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7488-2e20-4f26-b02d-cba37e49cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:01.555680 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7488-2e20-4f26-b02d-cba37e49cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:01.555955 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7488-2e20-4f26-b02d-cba37e49cdb4 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:01.556627 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e7488-2e20-4f26-b02d-cba37e49cdb4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:55:01.556925 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e7488-2e20-4f26-b02d-cba37e49cdb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:55:01.558294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e7488-2e20-4f26-b02d-cba37e49cdb4 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:55:01.563018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 453/912] 10.222.0.73 () {56 vars in 1116 bytes} [Wed Jul 27 17:55:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:55:01.569031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba69bd-a43a-49cd-a828-bcf11da7e53f None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:55:01.667911 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba69bd-a43a-49cd-a828-bcf11da7e53f None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:55:01.701186 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cb48f-bfb8-47bd-bad0-9c5690257584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:55:01.701795 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cb48f-bfb8-47bd-bad0-9c5690257584 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:01.702078 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cb48f-bfb8-47bd-bad0-9c5690257584 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:01.702355 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cb48f-bfb8-47bd-bad0-9c5690257584 None admin] PATH_INFO: `/v3/services` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:01.703067 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cb48f-bfb8-47bd-bad0-9c5690257584 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:55:01.703371 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cb48f-bfb8-47bd-bad0-9c5690257584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:55:01.704730 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cb48f-bfb8-47bd-bad0-9c5690257584 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:55:01.709260 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 460/913] 10.222.0.73 () {56 vars in 1116 bytes} [Wed Jul 27 17:55:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:55:03.921408 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ea66c-de41-4abd-8541-21ebd106e9e2 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:03.921930 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ea66c-de41-4abd-8541-21ebd106e9e2 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:03.922016 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ea66c-de41-4abd-8541-21ebd106e9e2 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:03.923473 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 454/914] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:55:03.928875 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382c2b3-00a6-48e6-8d5e-f37e052cdeee None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:03.929275 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382c2b3-00a6-48e6-8d5e-f37e052cdeee None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:03.929451 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382c2b3-00a6-48e6-8d5e-f37e052cdeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:03.947515 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-7382c2b3-00a6-48e6-8d5e-f37e052cdeee None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:55:03.948741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-7382c2b3-00a6-48e6-8d5e-f37e052cdeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:55:03.975224 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:55:04.015994 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 461/915] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:55:03 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:55:04.042289 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ea66c-de41-4abd-8541-21ebd106e9e2 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:55:04.073824 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:55:04.146037 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ea66c-de41-4abd-8541-21ebd106e9e2 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:55:04.179527 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5bb1-aa80-46b2-9666-981e3cf7b707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:55:04.180143 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5bb1-aa80-46b2-9666-981e3cf7b707 None admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:04.180426 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5bb1-aa80-46b2-9666-981e3cf7b707 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:04.180707 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5bb1-aa80-46b2-9666-981e3cf7b707 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:04.181403 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5bb1-aa80-46b2-9666-981e3cf7b707 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:55:04.182801 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5bb1-aa80-46b2-9666-981e3cf7b707 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:55:04.198139 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 455/916] 10.222.0.73 () {60 vars in 1141 bytes} [Wed Jul 27 17:55:04 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 17:55:06.432482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256f6c-210c-4625-947c-4f4207d66590 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:06.433014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256f6c-210c-4625-947c-4f4207d66590 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:06.433014 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256f6c-210c-4625-947c-4f4207d66590 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:06.434376 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 462/917] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:55:06.440011 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfcd0e-710e-44a0-babc-f99e6853e5c3 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:06.440445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfcd0e-710e-44a0-babc-f99e6853e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:06.440562 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfcd0e-710e-44a0-babc-f99e6853e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:06.459194 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-20bfcd0e-710e-44a0-babc-f99e6853e5c3 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:55:06.460429 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-20bfcd0e-710e-44a0-babc-f99e6853e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:55:06.535442 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 456/918] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:55:06 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:55:06.559478 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35256f6c-210c-4625-947c-4f4207d66590 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:55:06.662975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35256f6c-210c-4625-947c-4f4207d66590 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:55:06.696263 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5abfb-34c5-4d33-83ef-ca52c9467273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:55:06.696823 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5abfb-34c5-4d33-83ef-ca52c9467273 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:06.697101 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5abfb-34c5-4d33-83ef-ca52c9467273 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:06.697374 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5abfb-34c5-4d33-83ef-ca52c9467273 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:06.697987 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5abfb-34c5-4d33-83ef-ca52c9467273 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:55:06.699381 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5abfb-34c5-4d33-83ef-ca52c9467273 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-e4b5abfb-34c5-4d33-83ef-ca52c9467273 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:55:06.710541 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:55:06.715164 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:55:06.716600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 463/919] 10.222.0.73 () {56 vars in 1117 bytes} [Wed Jul 27 17:55:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:55:06.719035 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfcd0e-710e-44a0-babc-f99e6853e5c3 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:55:06.738267 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:55:06.819426 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfcd0e-710e-44a0-babc-f99e6853e5c3 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:55:06.853418 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485a1f8-44c5-4154-bc12-cfc3e6196d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:55:06.854035 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a1f8-44c5-4154-bc12-cfc3e6196d00 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:06.854317 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a1f8-44c5-4154-bc12-cfc3e6196d00 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:06.854619 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a1f8-44c5-4154-bc12-cfc3e6196d00 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:06.855296 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485a1f8-44c5-4154-bc12-cfc3e6196d00 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:55:06.855603 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485a1f8-44c5-4154-bc12-cfc3e6196d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:55:06.857871 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485a1f8-44c5-4154-bc12-cfc3e6196d00 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:55:06.863059 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 457/920] 10.222.0.73 () {56 vars in 1116 bytes} [Wed Jul 27 17:55:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:55:06.869083 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5abfb-34c5-4d33-83ef-ca52c9467273 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:55:06.896867 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:55:06.967668 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5abfb-34c5-4d33-83ef-ca52c9467273 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:55:07.003088 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e431-0f31-4862-9735-bef4f087b8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:55:07.003702 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e431-0f31-4862-9735-bef4f087b8e5 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:07.003985 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e431-0f31-4862-9735-bef4f087b8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:07.004257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e431-0f31-4862-9735-bef4f087b8e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:07.005218 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e431-0f31-4862-9735-bef4f087b8e5 None admin] RBAC: Adding query filter params (interface=public, service_id=d9ced5e28b6b4165b4025a61e0389a09, region_id=RegionOne) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:55:07.005528 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e431-0f31-4862-9735-bef4f087b8e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:55:07.006929 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e431-0f31-4862-9735-bef4f087b8e5 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:55:07.012448 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 464/921] 10.222.0.73 () {56 vars in 1251 bytes} [Wed Jul 27 17:55:06 2022] GET /identity/v3/endpoints?service_id=d9ced5e28b6b4165b4025a61e0389a09&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:55:07.018985 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485a1f8-44c5-4154-bc12-cfc3e6196d00 None admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:55:07.100265 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:55:07.118662 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485a1f8-44c5-4154-bc12-cfc3e6196d00 None admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:55:07.152858 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579dae-1911-427f-bea4-d4e89363fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:55:07.154081 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579dae-1911-427f-bea4-d4e89363fea0 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:07.154367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579dae-1911-427f-bea4-d4e89363fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:07.154688 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579dae-1911-427f-bea4-d4e89363fea0 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:07.155349 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58579dae-1911-427f-bea4-d4e89363fea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:55:07.156714 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58579dae-1911-427f-bea4-d4e89363fea0 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:55:07.163078 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 458/922] 10.222.0.73 () {56 vars in 1087 bytes} [Wed Jul 27 17:55:07 2022] GET /identity/v3/services => generated 1962 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 17:55:09.436288 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b94b1-bc04-4c4a-adb3-364a681d33a0 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:09.436870 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b94b1-bc04-4c4a-adb3-364a681d33a0 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:09.436870 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b94b1-bc04-4c4a-adb3-364a681d33a0 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:09.438194 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 465/923] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:55:09.443471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900af4a-fe3a-428d-b4f0-c6717a6f7ac5 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:09.443875 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900af4a-fe3a-428d-b4f0-c6717a6f7ac5 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:09.444036 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900af4a-fe3a-428d-b4f0-c6717a6f7ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:09.462186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-6900af4a-fe3a-428d-b4f0-c6717a6f7ac5 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:55:09.463422 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-6900af4a-fe3a-428d-b4f0-c6717a6f7ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:55:09.528160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 459/924] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:55:09 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 17:55:09.552242 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b94b1-bc04-4c4a-adb3-364a681d33a0 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:55:09.644498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:55:09.655244 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b94b1-bc04-4c4a-adb3-364a681d33a0 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:55:09.687546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fc169-be13-4281-b0e5-f6b549131314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:55:09.688123 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc169-be13-4281-b0e5-f6b549131314 None admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:09.688409 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc169-be13-4281-b0e5-f6b549131314 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:09.688688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc169-be13-4281-b0e5-f6b549131314 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:09.689312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fc169-be13-4281-b0e5-f6b549131314 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:55:09.690732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fc169-be13-4281-b0e5-f6b549131314 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application [None req-6c8fc169-be13-4281-b0e5-f6b549131314 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 17:55:09.699421 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 17:55:09.702384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application with Lock( Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self._enter() Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application return self.creator() Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application created_value = creator( Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: ERROR keystone.server.flask.application Jul 27 17:55:09.703468 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 466/925] 10.222.0.73 () {56 vars in 1117 bytes} [Wed Jul 27 17:55:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 17:55:09.707387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900af4a-fe3a-428d-b4f0-c6717a6f7ac5 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:55:09.783344 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:55:09.806032 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900af4a-fe3a-428d-b4f0-c6717a6f7ac5 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:55:09.840032 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889eaf4-a5a5-4239-babf-a690486dca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:55:09.840652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889eaf4-a5a5-4239-babf-a690486dca82 None admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:09.840980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889eaf4-a5a5-4239-babf-a690486dca82 None admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:09.841260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889eaf4-a5a5-4239-babf-a690486dca82 None admin] PATH_INFO: `/v3/services` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:09.841939 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889eaf4-a5a5-4239-babf-a690486dca82 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 17:55:09.842247 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889eaf4-a5a5-4239-babf-a690486dca82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:55:09.843652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889eaf4-a5a5-4239-babf-a690486dca82 None admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:55:09.848568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 460/926] 10.222.0.73 () {56 vars in 1116 bytes} [Wed Jul 27 17:55:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 17:55:09.854456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fc169-be13-4281-b0e5-f6b549131314 None admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:55:09.952718 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fc169-be13-4281-b0e5-f6b549131314 None admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:55:09.985389 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89939c-5013-457f-8826-ba8007e12675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:55:09.986005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89939c-5013-457f-8826-ba8007e12675 None admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:55:09.986317 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89939c-5013-457f-8826-ba8007e12675 None admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:55:09.986630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89939c-5013-457f-8826-ba8007e12675 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:55:09.987371 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89939c-5013-457f-8826-ba8007e12675 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:55:09.989021 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89939c-5013-457f-8826-ba8007e12675 None admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:55:10.010181 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 467/927] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 17:55:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 17:55:19.845735 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=30 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:55:20.006247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:56:09.511129 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bd0f7-1d14-451d-a019-fd0c70e26128 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:09.511595 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bd0f7-1d14-451d-a019-fd0c70e26128 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:09.511817 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bd0f7-1d14-451d-a019-fd0c70e26128 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:09.514554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 461/928] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:09.519465 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc238b5-b7d7-4977-b7cb-2e83c04e971b None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:09.519993 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc238b5-b7d7-4977-b7cb-2e83c04e971b None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:09.520087 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc238b5-b7d7-4977-b7cb-2e83c04e971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:09.539804 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-efc238b5-b7d7-4977-b7cb-2e83c04e971b None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:09.541181 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-efc238b5-b7d7-4977-b7cb-2e83c04e971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:09.629322 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 468/929] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:09.690689 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778afd-5cea-4c9c-8503-5af0fe3c7299 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:09.691074 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778afd-5cea-4c9c-8503-5af0fe3c7299 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:09.691488 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778afd-5cea-4c9c-8503-5af0fe3c7299 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:09.693460 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 462/930] 10.222.0.73 () {54 vars in 965 bytes} [Wed Jul 27 17:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:09.699843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214c47-e722-4495-9729-54e15600c17e None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:09.700237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214c47-e722-4495-9729-54e15600c17e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:09.700571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214c47-e722-4495-9729-54e15600c17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:09.779301 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-cd214c47-e722-4495-9729-54e15600c17e None None] MFA Rules not processed for user `54abb42639f1401bb6433e2d4642d741`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:09.780652 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-cd214c47-e722-4495-9729-54e15600c17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:09.857223 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 469/931] 10.222.0.73 () {58 vars in 1062 bytes} [Wed Jul 27 17:56:09 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:09.865850 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5778afd-5cea-4c9c-8503-5af0fe3c7299 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:09.878776 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5778afd-5cea-4c9c-8503-5af0fe3c7299 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:09.882066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbc055-09a5-4b91-80c4-dfc932271094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:09.882719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbc055-09a5-4b91-80c4-dfc932271094 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:09.884309 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbc055-09a5-4b91-80c4-dfc932271094 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:09.884309 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbc055-09a5-4b91-80c4-dfc932271094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:09.894278 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbc055-09a5-4b91-80c4-dfc932271094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:09.896285 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbc055-09a5-4b91-80c4-dfc932271094 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:09.908100 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 463/932] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:12.489218 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06b441-a4ec-40c5-a26b-3c09f009d273 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:12.489720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06b441-a4ec-40c5-a26b-3c09f009d273 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:12.489720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06b441-a4ec-40c5-a26b-3c09f009d273 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:12.491095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 470/933] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:12.496187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efc69-3801-4db4-8f7d-8a8c30aae97d None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:12.496625 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efc69-3801-4db4-8f7d-8a8c30aae97d None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:12.496973 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efc69-3801-4db4-8f7d-8a8c30aae97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:12.517205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-209efc69-3801-4db4-8f7d-8a8c30aae97d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:12.518432 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-209efc69-3801-4db4-8f7d-8a8c30aae97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:12.526593 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 464/934] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:12.581623 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6fe6a-7aab-4771-807b-841b01efad88 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:12.581908 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6fe6a-7aab-4771-807b-841b01efad88 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:12.582185 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6fe6a-7aab-4771-807b-841b01efad88 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:12.583597 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 471/935] 10.222.0.73 () {54 vars in 965 bytes} [Wed Jul 27 17:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:12.590007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e063-dfa5-419d-86d8-66c7aebda0c7 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:12.590650 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e063-dfa5-419d-86d8-66c7aebda0c7 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:12.591013 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e063-dfa5-419d-86d8-66c7aebda0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:12.611060 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-92c9e063-dfa5-419d-86d8-66c7aebda0c7 None None] MFA Rules not processed for user `54abb42639f1401bb6433e2d4642d741`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:12.612248 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-92c9e063-dfa5-419d-86d8-66c7aebda0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:12.619076 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 465/936] 10.222.0.73 () {58 vars in 1062 bytes} [Wed Jul 27 17:56:12 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:12.628957 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6fe6a-7aab-4771-807b-841b01efad88 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:12.640686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6fe6a-7aab-4771-807b-841b01efad88 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:12.645008 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ab354-0665-4de0-9bbd-6bdea7b5c535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:12.645652 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ab354-0665-4de0-9bbd-6bdea7b5c535 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:12.645937 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ab354-0665-4de0-9bbd-6bdea7b5c535 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:12.646215 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ab354-0665-4de0-9bbd-6bdea7b5c535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:12.656612 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ab354-0665-4de0-9bbd-6bdea7b5c535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:12.658075 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ab354-0665-4de0-9bbd-6bdea7b5c535 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:12.669459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 472/937] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:15.511774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5f166-d836-43e5-abd7-677c40eb34cd None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:15.512294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5f166-d836-43e5-abd7-677c40eb34cd None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:15.512518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5f166-d836-43e5-abd7-677c40eb34cd None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:15.513970 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 466/938] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:15.518985 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99170626-a03f-4537-ac5f-a9c884756aca None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:15.519371 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99170626-a03f-4537-ac5f-a9c884756aca None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:15.519555 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99170626-a03f-4537-ac5f-a9c884756aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:15.558631 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-99170626-a03f-4537-ac5f-a9c884756aca None None] MFA Rules not processed for user `16e1cb5a7f654af08a1dedd2f065c65d`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:15.559866 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-99170626-a03f-4537-ac5f-a9c884756aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:15.602538 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:56:15.632442 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 473/939] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:15 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:15.673574 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5f166-d836-43e5-abd7-677c40eb34cd None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:15.685141 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5f166-d836-43e5-abd7-677c40eb34cd None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:15.688664 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5122a0e-1b7e-4a03-a1e3-e8743f6989ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:15.689346 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5122a0e-1b7e-4a03-a1e3-e8743f6989ba service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:15.689698 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5122a0e-1b7e-4a03-a1e3-e8743f6989ba service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:15.690042 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5122a0e-1b7e-4a03-a1e3-e8743f6989ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:15.699582 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5122a0e-1b7e-4a03-a1e3-e8743f6989ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:15.701093 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5122a0e-1b7e-4a03-a1e3-e8743f6989ba service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:15.711051 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 467/940] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:15 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:18.711078 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d31fd-92da-422a-90b8-7cf2db80785e None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:18.711570 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d31fd-92da-422a-90b8-7cf2db80785e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:18.711665 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d31fd-92da-422a-90b8-7cf2db80785e None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:18.712979 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 474/941] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:18.718760 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39288946-7707-4faa-93c8-e8aed50444f9 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:18.719139 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39288946-7707-4faa-93c8-e8aed50444f9 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:18.719313 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39288946-7707-4faa-93c8-e8aed50444f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:18.738661 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-39288946-7707-4faa-93c8-e8aed50444f9 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:18.739854 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-39288946-7707-4faa-93c8-e8aed50444f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:18.806076 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 468/942] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:18 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:18.852006 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d31fd-92da-422a-90b8-7cf2db80785e None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:18.863000 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d31fd-92da-422a-90b8-7cf2db80785e None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:18.866368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d685818-eab7-419d-acdf-ca3008c619e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:18.867009 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d685818-eab7-419d-acdf-ca3008c619e9 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:18.867295 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d685818-eab7-419d-acdf-ca3008c619e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:18.867573 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d685818-eab7-419d-acdf-ca3008c619e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:18.876211 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d685818-eab7-419d-acdf-ca3008c619e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:18.877633 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d685818-eab7-419d-acdf-ca3008c619e9 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:18.887161 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 475/943] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:18 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:22.033461 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aa68e-86cb-44d6-9f36-1304d8aee15f None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:22.034006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aa68e-86cb-44d6-9f36-1304d8aee15f None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:22.034499 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aa68e-86cb-44d6-9f36-1304d8aee15f None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:22.037251 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 469/944] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:22.042420 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52fc8f-652f-4d27-8b88-72f52ae05736 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:22.043133 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52fc8f-652f-4d27-8b88-72f52ae05736 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:22.043619 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52fc8f-652f-4d27-8b88-72f52ae05736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:22.076338 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-6d52fc8f-652f-4d27-8b88-72f52ae05736 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:22.077540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-6d52fc8f-652f-4d27-8b88-72f52ae05736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:22.085671 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 476/945] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:22.123405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aa68e-86cb-44d6-9f36-1304d8aee15f None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:22.133697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aa68e-86cb-44d6-9f36-1304d8aee15f None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:22.137342 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa72a-77b9-4862-af34-ad3d73f789b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:22.137938 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa72a-77b9-4862-af34-ad3d73f789b3 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:22.138216 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa72a-77b9-4862-af34-ad3d73f789b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:22.138490 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa72a-77b9-4862-af34-ad3d73f789b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:22.147450 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa72a-77b9-4862-af34-ad3d73f789b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:22.148856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa72a-77b9-4862-af34-ad3d73f789b3 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:22.158535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 470/946] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:24.497398 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8349b9-7bb3-457f-9f7b-5a8e979d6672 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:24.497925 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8349b9-7bb3-457f-9f7b-5a8e979d6672 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:24.498041 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8349b9-7bb3-457f-9f7b-5a8e979d6672 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:24.499361 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 477/947] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:24.504535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47624933-73b1-4a1a-81c8-d6ea213f9b1c None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:24.504962 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47624933-73b1-4a1a-81c8-d6ea213f9b1c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:24.505107 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47624933-73b1-4a1a-81c8-d6ea213f9b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:24.524514 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-47624933-73b1-4a1a-81c8-d6ea213f9b1c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:24.525718 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-47624933-73b1-4a1a-81c8-d6ea213f9b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:24.533405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 471/948] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:24.571510 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8349b9-7bb3-457f-9f7b-5a8e979d6672 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:24.583197 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8349b9-7bb3-457f-9f7b-5a8e979d6672 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:24.586654 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f407383-a1e8-4a6a-9aef-9602b6a8791d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:24.587264 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f407383-a1e8-4a6a-9aef-9602b6a8791d service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:24.587547 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f407383-a1e8-4a6a-9aef-9602b6a8791d service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:24.587821 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f407383-a1e8-4a6a-9aef-9602b6a8791d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:24.598307 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f407383-a1e8-4a6a-9aef-9602b6a8791d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:24.600070 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f407383-a1e8-4a6a-9aef-9602b6a8791d service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:24.610035 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 478/949] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:26.928651 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620b213-703f-4cc1-91fc-1586a5f28631 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:26.929203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620b213-703f-4cc1-91fc-1586a5f28631 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:26.929203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620b213-703f-4cc1-91fc-1586a5f28631 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:26.930585 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 472/950] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:26.936345 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9ce7e-4ba5-457b-8002-a05a9c3795b6 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:26.936773 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9ce7e-4ba5-457b-8002-a05a9c3795b6 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:26.936887 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9ce7e-4ba5-457b-8002-a05a9c3795b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:26.955643 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-47e9ce7e-4ba5-457b-8002-a05a9c3795b6 None None] MFA Rules not processed for user `16e1cb5a7f654af08a1dedd2f065c65d`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:26.956855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-47e9ce7e-4ba5-457b-8002-a05a9c3795b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:26.965077 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 479/951] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:26 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:27.003186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620b213-703f-4cc1-91fc-1586a5f28631 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:27.014096 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620b213-703f-4cc1-91fc-1586a5f28631 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:27.017784 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a5da3-66f6-4c10-a98c-c4cc515da909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:27.018404 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5da3-66f6-4c10-a98c-c4cc515da909 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:27.018716 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5da3-66f6-4c10-a98c-c4cc515da909 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:27.018995 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5da3-66f6-4c10-a98c-c4cc515da909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:27.028793 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a5da3-66f6-4c10-a98c-c4cc515da909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:27.030221 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a5da3-66f6-4c10-a98c-c4cc515da909 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:27.039560 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 473/952] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:27 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:29.525470 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b43b5-aa66-48ce-9b65-9397a3f7d320 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:29.525989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b43b5-aa66-48ce-9b65-9397a3f7d320 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:29.526082 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b43b5-aa66-48ce-9b65-9397a3f7d320 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:29.528336 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 480/953] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:29.533547 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78fea7-2aa7-436c-b282-484ce617719f None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:29.533970 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78fea7-2aa7-436c-b282-484ce617719f None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:29.534105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78fea7-2aa7-436c-b282-484ce617719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:29.553755 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-0d78fea7-2aa7-436c-b282-484ce617719f None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:29.554997 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-0d78fea7-2aa7-436c-b282-484ce617719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:29.563571 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 474/954] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:29.601216 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b43b5-aa66-48ce-9b65-9397a3f7d320 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:29.611984 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b43b5-aa66-48ce-9b65-9397a3f7d320 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:29.615457 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14a9a4-ba35-40bf-9fb5-b628747f5d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:29.616073 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14a9a4-ba35-40bf-9fb5-b628747f5d78 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:29.616357 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14a9a4-ba35-40bf-9fb5-b628747f5d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:29.616633 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14a9a4-ba35-40bf-9fb5-b628747f5d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:29.625547 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14a9a4-ba35-40bf-9fb5-b628747f5d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:29.627022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14a9a4-ba35-40bf-9fb5-b628747f5d78 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:29.636879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 481/955] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:31.961026 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece1db3-2142-484b-87ae-b485c4b70599 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:31.961546 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece1db3-2142-484b-87ae-b485c4b70599 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:31.961666 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece1db3-2142-484b-87ae-b485c4b70599 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:31.963022 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 475/956] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:31.968316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ed976-2c74-48de-aefd-d0509f9225fd None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:31.968769 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ed976-2c74-48de-aefd-d0509f9225fd None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:31.968874 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ed976-2c74-48de-aefd-d0509f9225fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:31.988441 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-be2ed976-2c74-48de-aefd-d0509f9225fd None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:31.989637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-be2ed976-2c74-48de-aefd-d0509f9225fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:31.998142 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 482/957] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:32.037982 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece1db3-2142-484b-87ae-b485c4b70599 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:32.049141 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece1db3-2142-484b-87ae-b485c4b70599 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:32.052464 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa50b1-fd08-4b05-8f3f-882d6695fb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:32.053061 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa50b1-fd08-4b05-8f3f-882d6695fb0f service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:32.053338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa50b1-fd08-4b05-8f3f-882d6695fb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:32.053609 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa50b1-fd08-4b05-8f3f-882d6695fb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:32.062876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa50b1-fd08-4b05-8f3f-882d6695fb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:32.064284 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa50b1-fd08-4b05-8f3f-882d6695fb0f service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:32.073889 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 476/958] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:34.814671 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2ee84-07f6-47b4-ad20-d113ced7491a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:34.815119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2ee84-07f6-47b4-ad20-d113ced7491a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:34.815234 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2ee84-07f6-47b4-ad20-d113ced7491a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:34.816594 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 483/959] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:34.821711 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1a40e-4ee0-4210-aa5b-104ecf727732 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:34.822117 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1a40e-4ee0-4210-aa5b-104ecf727732 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:34.822263 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1a40e-4ee0-4210-aa5b-104ecf727732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:34.841438 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-e5f1a40e-4ee0-4210-aa5b-104ecf727732 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:34.842660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-e5f1a40e-4ee0-4210-aa5b-104ecf727732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:34.850336 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 477/960] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:34 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:34.887474 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2ee84-07f6-47b4-ad20-d113ced7491a None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:34.898115 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2ee84-07f6-47b4-ad20-d113ced7491a None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:34.902155 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77b802-8df4-4e23-89e7-f42904db680c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:34.902811 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77b802-8df4-4e23-89e7-f42904db680c service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:34.903097 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77b802-8df4-4e23-89e7-f42904db680c service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:34.903374 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77b802-8df4-4e23-89e7-f42904db680c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:34.912068 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77b802-8df4-4e23-89e7-f42904db680c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:34.913497 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77b802-8df4-4e23-89e7-f42904db680c service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:34.923680 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 484/961] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:34 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:39.115750 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46532fa6-6613-46a3-87f4-3925e1713e81 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:39.116285 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46532fa6-6613-46a3-87f4-3925e1713e81 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:39.116285 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46532fa6-6613-46a3-87f4-3925e1713e81 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:39.117559 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 478/962] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:39.123302 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912748fc-be95-423a-92cf-b798965821b1 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:39.123732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912748fc-be95-423a-92cf-b798965821b1 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:39.123992 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912748fc-be95-423a-92cf-b798965821b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:39.143679 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-912748fc-be95-423a-92cf-b798965821b1 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:39.144878 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-912748fc-be95-423a-92cf-b798965821b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:39.153280 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 485/963] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:39.203471 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46532fa6-6613-46a3-87f4-3925e1713e81 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:39.214120 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46532fa6-6613-46a3-87f4-3925e1713e81 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:39.217626 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88eccc-96ae-43c6-8a21-47c57f4a487f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:39.218244 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88eccc-96ae-43c6-8a21-47c57f4a487f service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:39.218554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88eccc-96ae-43c6-8a21-47c57f4a487f service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:39.218838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88eccc-96ae-43c6-8a21-47c57f4a487f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:39.227796 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88eccc-96ae-43c6-8a21-47c57f4a487f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:39.229240 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88eccc-96ae-43c6-8a21-47c57f4a487f service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:39.238439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 479/964] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:42.090282 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4effa5-f4bb-444d-998f-bdcfe501046c None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:42.090782 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4effa5-f4bb-444d-998f-bdcfe501046c None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:42.090895 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4effa5-f4bb-444d-998f-bdcfe501046c None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:42.092242 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 486/965] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:42.097678 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8451a93-7043-4191-bbc0-13a7beaa0bdb None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:42.098101 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8451a93-7043-4191-bbc0-13a7beaa0bdb None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:42.098245 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8451a93-7043-4191-bbc0-13a7beaa0bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:42.106205 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=83 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:56:42.122019 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-e8451a93-7043-4191-bbc0-13a7beaa0bdb None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:42.123318 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-e8451a93-7043-4191-bbc0-13a7beaa0bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:42.131071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 480/966] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:42 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:42.169688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4effa5-f4bb-444d-998f-bdcfe501046c None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:42.180540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4effa5-f4bb-444d-998f-bdcfe501046c None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:42.184552 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fc598-6e94-4548-85d0-71dbaa0c3bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:42.185163 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fc598-6e94-4548-85d0-71dbaa0c3bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:42.185444 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fc598-6e94-4548-85d0-71dbaa0c3bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:42.185722 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fc598-6e94-4548-85d0-71dbaa0c3bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:42.194902 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fc598-6e94-4548-85d0-71dbaa0c3bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:42.196310 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fc598-6e94-4548-85d0-71dbaa0c3bd9 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:42.206497 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 487/967] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:42 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:46.481503 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6428b5-c6e4-4771-972c-5b165abfd13f None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:46.482025 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6428b5-c6e4-4771-972c-5b165abfd13f None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:46.482136 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6428b5-c6e4-4771-972c-5b165abfd13f None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:46.483456 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 481/968] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:46.488689 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdb18d-51d0-40a8-aa3d-01309d697c8f None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:46.489088 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdb18d-51d0-40a8-aa3d-01309d697c8f None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:46.489249 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdb18d-51d0-40a8-aa3d-01309d697c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:46.497317 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=54 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:56:46.509835 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-26bdb18d-51d0-40a8-aa3d-01309d697c8f None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:46.511913 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-26bdb18d-51d0-40a8-aa3d-01309d697c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:46.519661 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 488/969] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:56:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:46.559268 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6428b5-c6e4-4771-972c-5b165abfd13f None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:56:46.569906 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6428b5-c6e4-4771-972c-5b165abfd13f None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:56:46.574059 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1a09a-1037-4e1e-97b3-b25759380d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:56:46.574698 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1a09a-1037-4e1e-97b3-b25759380d2d service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:46.574983 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1a09a-1037-4e1e-97b3-b25759380d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:46.575260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1a09a-1037-4e1e-97b3-b25759380d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:46.584146 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1a09a-1037-4e1e-97b3-b25759380d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:56:46.585570 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1a09a-1037-4e1e-97b3-b25759380d2d service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:56:46.594972 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 482/970] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:56:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:56:52.156120 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b8c04-8f94-4a68-9e3f-a0dc76066d44 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:52.157024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b8c04-8f94-4a68-9e3f-a0dc76066d44 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:52.157578 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b8c04-8f94-4a68-9e3f-a0dc76066d44 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:52.159395 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 489/971] 10.222.0.73 () {54 vars in 921 bytes} [Wed Jul 27 17:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:52.175091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8608be-163c-4241-bbff-3c0a12ada1b9 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:52.175609 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8608be-163c-4241-bbff-3c0a12ada1b9 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:52.175704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8608be-163c-4241-bbff-3c0a12ada1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:52.218054 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-9a8608be-163c-4241-bbff-3c0a12ada1b9 None None] MFA Rules not processed for user `5144a9d861f8482a8f31abc1315fe818`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:52.219680 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-9a8608be-163c-4241-bbff-3c0a12ada1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:52.309337 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 483/972] 10.222.0.73 () {58 vars in 1018 bytes} [Wed Jul 27 17:56:52 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:56.505151 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=2 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:56:56.708525 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bead90-1e03-4992-948d-d16c1c1ede94 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:56.708815 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bead90-1e03-4992-948d-d16c1c1ede94 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:56.709279 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bead90-1e03-4992-948d-d16c1c1ede94 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:56.710931 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 490/973] 10.222.0.73 () {54 vars in 921 bytes} [Wed Jul 27 17:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:56.716359 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569667-72c8-419b-8ca6-ca2c5d34b75a None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:56.716862 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569667-72c8-419b-8ca6-ca2c5d34b75a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:56.717123 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569667-72c8-419b-8ca6-ca2c5d34b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:56.742528 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-e8569667-72c8-419b-8ca6-ca2c5d34b75a None None] MFA Rules not processed for user `5144a9d861f8482a8f31abc1315fe818`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:56.743894 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-e8569667-72c8-419b-8ca6-ca2c5d34b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:56.753365 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 484/974] 10.222.0.73 () {58 vars in 1018 bytes} [Wed Jul 27 17:56:56 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:56:58.196091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0068-1ddc-420e-9e1f-4e50f34cb453 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:58.196644 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0068-1ddc-420e-9e1f-4e50f34cb453 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:58.196812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0068-1ddc-420e-9e1f-4e50f34cb453 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:58.198913 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 491/975] 10.222.0.73 () {54 vars in 921 bytes} [Wed Jul 27 17:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:56:58.203997 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19ea47-55c6-4a97-84c0-4aefa616c943 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:56:58.204428 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19ea47-55c6-4a97-84c0-4aefa616c943 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:56:58.204539 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19ea47-55c6-4a97-84c0-4aefa616c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:56:58.223518 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-eb19ea47-55c6-4a97-84c0-4aefa616c943 None None] MFA Rules not processed for user `5144a9d861f8482a8f31abc1315fe818`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:56:58.224692 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-eb19ea47-55c6-4a97-84c0-4aefa616c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:56:58.233483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 485/976] 10.222.0.73 () {58 vars in 1018 bytes} [Wed Jul 27 17:56:58 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:02.246118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b37cf-cc68-4b81-b542-74e2710c5296 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:02.246725 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b37cf-cc68-4b81-b542-74e2710c5296 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:02.246725 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b37cf-cc68-4b81-b542-74e2710c5296 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:02.248408 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 492/977] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:02.253401 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dafa1e-788e-4a1a-ad63-cc6becf9a045 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:02.253801 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dafa1e-788e-4a1a-ad63-cc6becf9a045 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:02.253964 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dafa1e-788e-4a1a-ad63-cc6becf9a045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:02.274435 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-87dafa1e-788e-4a1a-ad63-cc6becf9a045 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:02.276484 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-87dafa1e-788e-4a1a-ad63-cc6becf9a045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:02.284465 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 486/978] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:02.341817 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b0bd-7bef-4e69-a5da-8fae92e937c2 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:02.342225 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b0bd-7bef-4e69-a5da-8fae92e937c2 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:02.342657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b0bd-7bef-4e69-a5da-8fae92e937c2 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:02.345172 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 493/979] 10.222.0.73 () {54 vars in 962 bytes} [Wed Jul 27 17:57:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:02.360210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c684b80-9f48-4afa-bb01-7e6288313401 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:02.360678 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c684b80-9f48-4afa-bb01-7e6288313401 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:02.361196 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c684b80-9f48-4afa-bb01-7e6288313401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:02.403914 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-4c684b80-9f48-4afa-bb01-7e6288313401 None None] MFA Rules not processed for user `de6300c387da4594bca473cd708b79f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:02.405597 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-4c684b80-9f48-4afa-bb01-7e6288313401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:02.484127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 487/980] 10.222.0.73 () {58 vars in 1059 bytes} [Wed Jul 27 17:57:02 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:02.492166 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580b0bd-7bef-4e69-a5da-8fae92e937c2 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:02.505867 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580b0bd-7bef-4e69-a5da-8fae92e937c2 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:02.510939 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38a58c-39f4-408e-8c32-4dbb511dffc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:02.511660 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38a58c-39f4-408e-8c32-4dbb511dffc6 service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:02.511952 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38a58c-39f4-408e-8c32-4dbb511dffc6 service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:02.512231 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38a58c-39f4-408e-8c32-4dbb511dffc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:02.520258 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38a58c-39f4-408e-8c32-4dbb511dffc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:02.521869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38a58c-39f4-408e-8c32-4dbb511dffc6 service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:02.533695 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 494/981] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 17:57:05.018867 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bd7f8-5a8e-4c6b-bba9-c6d6e789f0d1 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:05.019372 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bd7f8-5a8e-4c6b-bba9-c6d6e789f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:05.019372 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bd7f8-5a8e-4c6b-bba9-c6d6e789f0d1 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:05.021226 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 488/982] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:05.026861 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631ac3-1d46-4875-ae84-f118a4195f86 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:05.027283 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631ac3-1d46-4875-ae84-f118a4195f86 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:05.027283 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631ac3-1d46-4875-ae84-f118a4195f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:05.048781 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-d2631ac3-1d46-4875-ae84-f118a4195f86 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:05.050000 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-d2631ac3-1d46-4875-ae84-f118a4195f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:05.058176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 495/983] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:05.107671 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bd7f8-5a8e-4c6b-bba9-c6d6e789f0d1 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:05.122260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bd7f8-5a8e-4c6b-bba9-c6d6e789f0d1 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:05.127700 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561309f2-18ad-401b-adf9-28b8ce0c2188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:05.128342 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561309f2-18ad-401b-adf9-28b8ce0c2188 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:05.128626 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561309f2-18ad-401b-adf9-28b8ce0c2188 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:05.128903 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561309f2-18ad-401b-adf9-28b8ce0c2188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:05.139288 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561309f2-18ad-401b-adf9-28b8ce0c2188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:05.140892 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561309f2-18ad-401b-adf9-28b8ce0c2188 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:05.145170 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:57:05.153084 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 489/984] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:07.742588 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b014f2d-7889-4805-aa2c-102faca418ac None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:07.743529 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b014f2d-7889-4805-aa2c-102faca418ac None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:07.744565 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b014f2d-7889-4805-aa2c-102faca418ac None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:07.747422 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 496/985] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:07.751941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dcc34-7b3a-4836-b8a9-880e7b190213 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:07.752387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dcc34-7b3a-4836-b8a9-880e7b190213 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:07.752505 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dcc34-7b3a-4836-b8a9-880e7b190213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:07.772559 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-ad2dcc34-7b3a-4836-b8a9-880e7b190213 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:07.774290 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-ad2dcc34-7b3a-4836-b8a9-880e7b190213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:07.782176 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 490/986] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:07.836023 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da0979-6d53-4a1e-a686-4d2ff4393991 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:07.836273 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da0979-6d53-4a1e-a686-4d2ff4393991 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:07.836532 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da0979-6d53-4a1e-a686-4d2ff4393991 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:07.838080 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 497/987] 10.222.0.73 () {54 vars in 962 bytes} [Wed Jul 27 17:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:07.843237 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fff485-a88e-414a-9e8a-5741ef6f5bed None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:07.843522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fff485-a88e-414a-9e8a-5741ef6f5bed None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:07.843797 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fff485-a88e-414a-9e8a-5741ef6f5bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:07.864117 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-96fff485-a88e-414a-9e8a-5741ef6f5bed None None] MFA Rules not processed for user `de6300c387da4594bca473cd708b79f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:07.865363 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-96fff485-a88e-414a-9e8a-5741ef6f5bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:07.874139 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 491/988] 10.222.0.73 () {58 vars in 1059 bytes} [Wed Jul 27 17:57:07 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 17:57:07.882690 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da0979-6d53-4a1e-a686-4d2ff4393991 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:07.896660 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da0979-6d53-4a1e-a686-4d2ff4393991 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:07.902776 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac695c5-d8b7-41c8-9de6-73c260b17f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:07.903462 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac695c5-d8b7-41c8-9de6-73c260b17f0a service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:07.903818 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac695c5-d8b7-41c8-9de6-73c260b17f0a service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:07.904161 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac695c5-d8b7-41c8-9de6-73c260b17f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:07.913043 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac695c5-d8b7-41c8-9de6-73c260b17f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:07.914676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac695c5-d8b7-41c8-9de6-73c260b17f0a service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:07.925328 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 498/989] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:10.299418 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8038e-8521-40bd-9465-7f6c09f03c65 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:10.299936 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8038e-8521-40bd-9465-7f6c09f03c65 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:10.299936 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8038e-8521-40bd-9465-7f6c09f03c65 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:10.301380 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 492/990] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:10.306889 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00fcd-92f1-4ca4-b1aa-184aeac14015 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:10.307681 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00fcd-92f1-4ca4-b1aa-184aeac14015 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:10.308118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00fcd-92f1-4ca4-b1aa-184aeac14015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:10.328598 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-29f00fcd-92f1-4ca4-b1aa-184aeac14015 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:10.330048 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-29f00fcd-92f1-4ca4-b1aa-184aeac14015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:10.350967 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 499/991] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:10.386350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8038e-8521-40bd-9465-7f6c09f03c65 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:10.401064 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8038e-8521-40bd-9465-7f6c09f03c65 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:10.406563 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df5dea-b69c-4987-a18c-5b94bc0e341e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:10.407359 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5dea-b69c-4987-a18c-5b94bc0e341e service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:10.407822 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5dea-b69c-4987-a18c-5b94bc0e341e service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:10.408253 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5dea-b69c-4987-a18c-5b94bc0e341e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:10.418914 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df5dea-b69c-4987-a18c-5b94bc0e341e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:10.420710 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df5dea-b69c-4987-a18c-5b94bc0e341e service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:10.442914 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 493/992] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:12.330560 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7f528-a362-4d9c-b2b3-1001b8bf103e None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:12.330560 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7f528-a362-4d9c-b2b3-1001b8bf103e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:12.330560 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7f528-a362-4d9c-b2b3-1001b8bf103e None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:12.334658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 500/993] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:12.337382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b166-e625-4949-a5e3-00c115616aba None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:12.337974 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b166-e625-4949-a5e3-00c115616aba None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:12.338073 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b166-e625-4949-a5e3-00c115616aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:12.358122 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-0886b166-e625-4949-a5e3-00c115616aba None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:12.359366 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-0886b166-e625-4949-a5e3-00c115616aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:12.368736 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 494/994] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:12.694503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6c17-2dd2-4826-a727-cd7593a8c764 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:12.694924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6c17-2dd2-4826-a727-cd7593a8c764 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:12.695271 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6c17-2dd2-4826-a727-cd7593a8c764 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:12.697018 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 501/995] 10.222.0.73 () {54 vars in 964 bytes} [Wed Jul 27 17:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:12.701936 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a813e-c6a4-4bc8-9bf6-d80d366a809c None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:12.702234 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a813e-c6a4-4bc8-9bf6-d80d366a809c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:12.702543 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a813e-c6a4-4bc8-9bf6-d80d366a809c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:12.744051 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-6a2a813e-c6a4-4bc8-9bf6-d80d366a809c None None] MFA Rules not processed for user `856e3f650ab34f15828f1adb320d03ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:12.745352 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-6a2a813e-c6a4-4bc8-9bf6-d80d366a809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:12.826165 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 495/996] 10.222.0.73 () {58 vars in 1061 bytes} [Wed Jul 27 17:57:12 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 17:57:12.834282 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b6c17-2dd2-4826-a727-cd7593a8c764 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:12.845862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b6c17-2dd2-4826-a727-cd7593a8c764 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:12.849503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bde3a-6c6c-433e-b685-17cf0956f76c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856e3f650ab34f15828f1adb320d03ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:12.850117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bde3a-6c6c-433e-b685-17cf0956f76c service cinder] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:12.850403 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bde3a-6c6c-433e-b685-17cf0956f76c service cinder] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:12.850715 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bde3a-6c6c-433e-b685-17cf0956f76c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:12.861005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bde3a-6c6c-433e-b685-17cf0956f76c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:12.862438 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bde3a-6c6c-433e-b685-17cf0956f76c service cinder] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:12.872537 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 502/997] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:12.911097 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd95144-d601-4e85-9773-c8ae1473555e None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:12.911301 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd95144-d601-4e85-9773-c8ae1473555e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:12.911773 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd95144-d601-4e85-9773-c8ae1473555e None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:12.913372 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 496/998] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:12.922332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264ecba-4e1c-4415-85ed-26583c59fd74 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:12.922664 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264ecba-4e1c-4415-85ed-26583c59fd74 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:12.923357 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264ecba-4e1c-4415-85ed-26583c59fd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:12.944372 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-5264ecba-4e1c-4415-85ed-26583c59fd74 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:12.945618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-5264ecba-4e1c-4415-85ed-26583c59fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:12.954478 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 503/999] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:12.999777 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd95144-d601-4e85-9773-c8ae1473555e None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:13.013920 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd95144-d601-4e85-9773-c8ae1473555e None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:13.019001 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaf654-8bc5-4aa7-a1f1-1fa2c85ea0d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:13.019615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf654-8bc5-4aa7-a1f1-1fa2c85ea0d9 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:13.019900 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf654-8bc5-4aa7-a1f1-1fa2c85ea0d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:13.020183 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf654-8bc5-4aa7-a1f1-1fa2c85ea0d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:13.029199 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaf654-8bc5-4aa7-a1f1-1fa2c85ea0d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:13.030845 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaf654-8bc5-4aa7-a1f1-1fa2c85ea0d9 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:13.041282 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 497/1000] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 17:57:15.330883 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f6f59-fb62-4ee3-84d8-6bf781c662f5 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:15.331344 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f6f59-fb62-4ee3-84d8-6bf781c662f5 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:15.331601 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f6f59-fb62-4ee3-84d8-6bf781c662f5 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:15.332971 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 504/1001] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:15.339088 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1129-952c-4dcd-8957-7d8c70192019 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:15.339608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1129-952c-4dcd-8957-7d8c70192019 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:15.339608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1129-952c-4dcd-8957-7d8c70192019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:15.358730 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-7e6a1129-952c-4dcd-8957-7d8c70192019 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:15.359928 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-7e6a1129-952c-4dcd-8957-7d8c70192019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:15.367630 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 498/1002] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 17:57:15.414637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f6f59-fb62-4ee3-84d8-6bf781c662f5 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:15.428717 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f6f59-fb62-4ee3-84d8-6bf781c662f5 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:15.434591 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25f982-cecf-410a-ad65-15f891449832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:15.435217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25f982-cecf-410a-ad65-15f891449832 service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:15.435505 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25f982-cecf-410a-ad65-15f891449832 service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:15.435794 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25f982-cecf-410a-ad65-15f891449832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:15.444703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25f982-cecf-410a-ad65-15f891449832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:15.446328 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25f982-cecf-410a-ad65-15f891449832 service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:15.456839 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 505/1003] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:17.751601 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a84bcf-347d-45c7-97f9-5f03335d9a03 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:17.752131 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a84bcf-347d-45c7-97f9-5f03335d9a03 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:17.752131 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a84bcf-347d-45c7-97f9-5f03335d9a03 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:17.754838 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 499/1004] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:17.758559 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160da8-35c7-49fc-b386-6f10fea4135c None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:17.758948 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160da8-35c7-49fc-b386-6f10fea4135c None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:17.759108 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160da8-35c7-49fc-b386-6f10fea4135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:17.780513 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-01160da8-35c7-49fc-b386-6f10fea4135c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:17.781715 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-01160da8-35c7-49fc-b386-6f10fea4135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:17.798887 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 506/1005] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:17.833439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a84bcf-347d-45c7-97f9-5f03335d9a03 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:17.847461 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a84bcf-347d-45c7-97f9-5f03335d9a03 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:17.852420 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d38fd9-59eb-4a5a-841a-e8ef348c6b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:17.853739 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38fd9-59eb-4a5a-841a-e8ef348c6b90 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:17.854255 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38fd9-59eb-4a5a-841a-e8ef348c6b90 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:17.854817 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38fd9-59eb-4a5a-841a-e8ef348c6b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:17.863263 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d38fd9-59eb-4a5a-841a-e8ef348c6b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:17.864905 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d38fd9-59eb-4a5a-841a-e8ef348c6b90 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:17.875887 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 500/1006] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:20.171383 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662d715-6c05-4f6e-a730-1fc63a23e576 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:20.171941 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662d715-6c05-4f6e-a730-1fc63a23e576 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:20.171941 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662d715-6c05-4f6e-a730-1fc63a23e576 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:20.173286 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 507/1007] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:20.178461 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f125-74f2-42c2-ae35-5374d38d1781 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:20.178962 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f125-74f2-42c2-ae35-5374d38d1781 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:20.179071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f125-74f2-42c2-ae35-5374d38d1781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:20.198634 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-9230f125-74f2-42c2-ae35-5374d38d1781 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:20.200036 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-9230f125-74f2-42c2-ae35-5374d38d1781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:20.207941 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 501/1008] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:20.261366 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662d715-6c05-4f6e-a730-1fc63a23e576 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:20.278060 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662d715-6c05-4f6e-a730-1fc63a23e576 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:20.283037 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0e740-b535-4375-b1ad-d19051946f08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:20.283651 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0e740-b535-4375-b1ad-d19051946f08 service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:20.283935 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0e740-b535-4375-b1ad-d19051946f08 service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:20.284212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0e740-b535-4375-b1ad-d19051946f08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:20.292756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0e740-b535-4375-b1ad-d19051946f08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:20.294344 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0e740-b535-4375-b1ad-d19051946f08 service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:20.304288 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 508/1009] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:23.281274 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c034f9-8953-471b-bdba-c283f4185a8a None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:23.284091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c034f9-8953-471b-bdba-c283f4185a8a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:23.284091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c034f9-8953-471b-bdba-c283f4185a8a None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:23.284091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 502/1010] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:23.290838 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b9e6-119c-4c26-9467-c20827f10aea None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:23.291568 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b9e6-119c-4c26-9467-c20827f10aea None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:23.292580 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b9e6-119c-4c26-9467-c20827f10aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:23.334782 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-0b39b9e6-119c-4c26-9467-c20827f10aea None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:23.336086 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-0b39b9e6-119c-4c26-9467-c20827f10aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:23.344867 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 509/1011] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:23.412914 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c034f9-8953-471b-bdba-c283f4185a8a None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:23.426815 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c034f9-8953-471b-bdba-c283f4185a8a None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:23.432347 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5789f-7e8e-44d7-acd4-74cd72fbd7ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:23.432969 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5789f-7e8e-44d7-acd4-74cd72fbd7ed service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:23.433255 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5789f-7e8e-44d7-acd4-74cd72fbd7ed service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:23.433536 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5789f-7e8e-44d7-acd4-74cd72fbd7ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:23.442317 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5789f-7e8e-44d7-acd4-74cd72fbd7ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:23.444070 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5789f-7e8e-44d7-acd4-74cd72fbd7ed service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:23.454159 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 503/1012] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:26.091339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5a80f-b883-4239-adb4-4732efe48a8f None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:26.091961 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5a80f-b883-4239-adb4-4732efe48a8f None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:26.091961 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5a80f-b883-4239-adb4-4732efe48a8f None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:26.093240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 510/1013] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:26.098611 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeeae8-67e3-4fc7-8c87-69b5c7f577a1 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:26.099231 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeeae8-67e3-4fc7-8c87-69b5c7f577a1 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:26.099231 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeeae8-67e3-4fc7-8c87-69b5c7f577a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:26.120204 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-79aeeae8-67e3-4fc7-8c87-69b5c7f577a1 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:26.121450 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-79aeeae8-67e3-4fc7-8c87-69b5c7f577a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:26.129409 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 504/1014] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:26.176017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5a80f-b883-4239-adb4-4732efe48a8f None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:26.190136 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5a80f-b883-4239-adb4-4732efe48a8f None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:26.195994 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f2687-743c-442c-9c41-bfb0e688c295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:26.197004 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2687-743c-442c-9c41-bfb0e688c295 service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:26.197438 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2687-743c-442c-9c41-bfb0e688c295 service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:26.197973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2687-743c-442c-9c41-bfb0e688c295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:26.208425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f2687-743c-442c-9c41-bfb0e688c295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:26.210038 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f2687-743c-442c-9c41-bfb0e688c295 service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:26.220168 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 511/1015] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:28.909527 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44504e-0e31-4613-a4b9-d9f035928036 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:28.910130 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44504e-0e31-4613-a4b9-d9f035928036 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:28.910130 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44504e-0e31-4613-a4b9-d9f035928036 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:28.911368 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 505/1016] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:28.917240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f7f7-5fa1-4fc3-ad09-c78dd98b703e None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:28.917950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f7f7-5fa1-4fc3-ad09-c78dd98b703e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:28.917950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f7f7-5fa1-4fc3-ad09-c78dd98b703e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:28.925213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=52 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:57:28.933191 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9cb7-2f3b-407d-9bb6-07e63e8e6930 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:28.933477 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9cb7-2f3b-407d-9bb6-07e63e8e6930 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:28.933760 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9cb7-2f3b-407d-9bb6-07e63e8e6930 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:28.935118 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 506/1017] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:57:28.938640 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-3570f7f7-5fa1-4fc3-ad09-c78dd98b703e None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:28.940106 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-3570f7f7-5fa1-4fc3-ad09-c78dd98b703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:28.940246 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c072-e39b-45db-a3d9-fbb002528c6e None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:28.940411 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c072-e39b-45db-a3d9-fbb002528c6e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:28.940662 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c072-e39b-45db-a3d9-fbb002528c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:28.948813 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 512/1018] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:28.960857 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-32c3c072-e39b-45db-a3d9-fbb002528c6e None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:28.962056 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-32c3c072-e39b-45db-a3d9-fbb002528c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:28.970036 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 507/1019] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 17:57:28.995142 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570f7f7-5fa1-4fc3-ad09-c78dd98b703e None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:29.007085 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570f7f7-5fa1-4fc3-ad09-c78dd98b703e None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:29.012810 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a3b60-10bb-4668-ae3e-ea1c88fc2ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:29.013428 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a3b60-10bb-4668-ae3e-ea1c88fc2ac5 service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:29.013712 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a3b60-10bb-4668-ae3e-ea1c88fc2ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:29.013992 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a3b60-10bb-4668-ae3e-ea1c88fc2ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:29.022397 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a3b60-10bb-4668-ae3e-ea1c88fc2ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:29.024026 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a3b60-10bb-4668-ae3e-ea1c88fc2ac5 service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:29.027814 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e25eea-b680-4c3c-a80f-56c408c56269 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:29.028102 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e25eea-b680-4c3c-a80f-56c408c56269 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:29.028377 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e25eea-b680-4c3c-a80f-56c408c56269 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:29.029714 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 508/1020] 10.222.0.73 () {54 vars in 966 bytes} [Wed Jul 27 17:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:57:29.034407 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 513/1021] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:29.034593 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abe586-d0ae-4d44-876d-f22725f23a59 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:29.034821 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abe586-d0ae-4d44-876d-f22725f23a59 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:29.035099 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abe586-d0ae-4d44-876d-f22725f23a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:29.076251 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-e8abe586-d0ae-4d44-876d-f22725f23a59 None None] MFA Rules not processed for user `dd0601985b76490dae3f9d0ce2fe9505`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:29.077467 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-e8abe586-d0ae-4d44-876d-f22725f23a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:29.113987 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:57:29.149973 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 509/1022] 10.222.0.73 () {58 vars in 1063 bytes} [Wed Jul 27 17:57:29 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 17:57:29.158339 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a3b60-10bb-4668-ae3e-ea1c88fc2ac5 service nova] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:29.169238 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a3b60-10bb-4668-ae3e-ea1c88fc2ac5 service nova] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:29.172811 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d00c8c-42fc-45c5-89f0-4aef066ea943 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0601985b76490dae3f9d0ce2fe9505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:29.173470 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00c8c-42fc-45c5-89f0-4aef066ea943 service glance] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:29.173747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00c8c-42fc-45c5-89f0-4aef066ea943 service glance] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:29.174029 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00c8c-42fc-45c5-89f0-4aef066ea943 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:29.184177 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d00c8c-42fc-45c5-89f0-4aef066ea943 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:29.185659 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d00c8c-42fc-45c5-89f0-4aef066ea943 service glance] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:29.196166 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 514/1023] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:31.366195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50e015-c714-4674-b42f-e49f66c6a03a None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:31.366883 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50e015-c714-4674-b42f-e49f66c6a03a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:31.366883 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50e015-c714-4674-b42f-e49f66c6a03a None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:31.368137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 510/1024] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:31.373582 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5858dcc-195e-4170-8dd3-e738b1db7bcc None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:31.374036 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5858dcc-195e-4170-8dd3-e738b1db7bcc None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:31.376022 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5858dcc-195e-4170-8dd3-e738b1db7bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:31.399758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-d5858dcc-195e-4170-8dd3-e738b1db7bcc None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:31.402008 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-d5858dcc-195e-4170-8dd3-e738b1db7bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:31.412940 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 515/1025] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:57:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:31.459105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50e015-c714-4674-b42f-e49f66c6a03a None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:31.473285 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50e015-c714-4674-b42f-e49f66c6a03a None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:31.480279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41396e-412a-4ee1-b4e9-1fbf4e5d8075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:31.480910 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41396e-412a-4ee1-b4e9-1fbf4e5d8075 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:31.481197 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41396e-412a-4ee1-b4e9-1fbf4e5d8075 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:31.481478 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41396e-412a-4ee1-b4e9-1fbf4e5d8075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:31.492066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41396e-412a-4ee1-b4e9-1fbf4e5d8075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:31.492066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41396e-412a-4ee1-b4e9-1fbf4e5d8075 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:31.502704 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 511/1026] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:41.391089 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=17 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:57:41.498565 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=18 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:57:44.333875 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c0fc-49ab-4669-bbe8-70aa7f3aa477 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:44.334486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c0fc-49ab-4669-bbe8-70aa7f3aa477 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:44.334486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c0fc-49ab-4669-bbe8-70aa7f3aa477 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:44.335828 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 516/1027] 10.222.0.73 () {54 vars in 918 bytes} [Wed Jul 27 17:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:44.341806 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0766-c13b-4fc8-8694-f2e8c0ce3335 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:44.342249 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0766-c13b-4fc8-8694-f2e8c0ce3335 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:44.342404 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0766-c13b-4fc8-8694-f2e8c0ce3335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:44.361374 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-23ec0766-c13b-4fc8-8694-f2e8c0ce3335 None None] MFA Rules not processed for user `5144a9d861f8482a8f31abc1315fe818`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:44.363125 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-23ec0766-c13b-4fc8-8694-f2e8c0ce3335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:44.371837 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 512/1028] 10.222.0.73 () {58 vars in 1015 bytes} [Wed Jul 27 17:57:44 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:44.386133 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69559d2-64c9-417e-9d63-d76813336543 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:44.386416 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69559d2-64c9-417e-9d63-d76813336543 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:44.386736 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69559d2-64c9-417e-9d63-d76813336543 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:44.388066 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 517/1029] 10.222.0.73 () {54 vars in 918 bytes} [Wed Jul 27 17:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:44.392456 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c62772-dc53-49ce-8680-3c30a0a77b76 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:44.392766 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c62772-dc53-49ce-8680-3c30a0a77b76 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:44.393043 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c62772-dc53-49ce-8680-3c30a0a77b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:44.412486 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-19c62772-dc53-49ce-8680-3c30a0a77b76 None None] MFA Rules not processed for user `de6300c387da4594bca473cd708b79f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:44.413670 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-19c62772-dc53-49ce-8680-3c30a0a77b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:44.421861 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 513/1030] 10.222.0.73 () {58 vars in 1015 bytes} [Wed Jul 27 17:57:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:47.163281 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a406-98e3-4009-a0a9-6ef80fe4897a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:47.163861 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a406-98e3-4009-a0a9-6ef80fe4897a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:47.163861 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a406-98e3-4009-a0a9-6ef80fe4897a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:47.165347 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 518/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 17:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:47.170417 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ecd9e-a863-4a9e-ae28-9f73ef905848 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:47.170888 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ecd9e-a863-4a9e-ae28-9f73ef905848 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:47.171014 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ecd9e-a863-4a9e-ae28-9f73ef905848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:47.190031 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-3f2ecd9e-a863-4a9e-ae28-9f73ef905848 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:47.191252 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-3f2ecd9e-a863-4a9e-ae28-9f73ef905848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:47.199460 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 514/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 17:57:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:47.243404 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90a406-98e3-4009-a0a9-6ef80fe4897a None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:47.257512 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90a406-98e3-4009-a0a9-6ef80fe4897a None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:47.263220 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36269387-4c3a-4050-ad92-7ab8113c4218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:47.263826 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36269387-4c3a-4050-ad92-7ab8113c4218 service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:47.264109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36269387-4c3a-4050-ad92-7ab8113c4218 service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:47.264384 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36269387-4c3a-4050-ad92-7ab8113c4218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:47.272298 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36269387-4c3a-4050-ad92-7ab8113c4218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:47.273862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36269387-4c3a-4050-ad92-7ab8113c4218 service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:47.284394 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 519/1033] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:48.247680 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047ee5-10d1-4e95-854b-446b4de63cac None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:48.248213 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047ee5-10d1-4e95-854b-446b4de63cac None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:48.248337 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047ee5-10d1-4e95-854b-446b4de63cac None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:48.249623 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 515/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 17:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:48.254605 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3df57-f12a-42c2-af4a-b4b6d71b15b0 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:48.255042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3df57-f12a-42c2-af4a-b4b6d71b15b0 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:48.255347 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3df57-f12a-42c2-af4a-b4b6d71b15b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:48.274156 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-0ae3df57-f12a-42c2-af4a-b4b6d71b15b0 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:48.275724 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-0ae3df57-f12a-42c2-af4a-b4b6d71b15b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:48.283356 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 520/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 17:57:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:48.476307 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67047ee5-10d1-4e95-854b-446b4de63cac None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:48.490172 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67047ee5-10d1-4e95-854b-446b4de63cac None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:48.495083 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8c94a-ee99-478d-9489-a5c2c5f36e58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:48.495708 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8c94a-ee99-478d-9489-a5c2c5f36e58 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:48.495989 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8c94a-ee99-478d-9489-a5c2c5f36e58 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:48.496263 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8c94a-ee99-478d-9489-a5c2c5f36e58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:48.504210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8c94a-ee99-478d-9489-a5c2c5f36e58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:48.505726 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8c94a-ee99-478d-9489-a5c2c5f36e58 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:48.514968 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 516/1036] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:49.421563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45af2-9084-4800-9022-f4d52f264a14 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:49.422130 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45af2-9084-4800-9022-f4d52f264a14 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:49.422130 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45af2-9084-4800-9022-f4d52f264a14 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:49.423510 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 521/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 17:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:49.428311 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f0040-0ea9-40ed-83ef-e6f7398c4a7d None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:49.428734 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f0040-0ea9-40ed-83ef-e6f7398c4a7d None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:49.428879 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f0040-0ea9-40ed-83ef-e6f7398c4a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:49.449340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-074f0040-0ea9-40ed-83ef-e6f7398c4a7d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:49.450575 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-074f0040-0ea9-40ed-83ef-e6f7398c4a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:49.458303 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 517/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 17:57:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:49.614552 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45af2-9084-4800-9022-f4d52f264a14 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:49.627720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45af2-9084-4800-9022-f4d52f264a14 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:49.632496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867efabe-f82f-454b-9da6-9cf5577e7b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:49.633095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867efabe-f82f-454b-9da6-9cf5577e7b30 service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:49.633376 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867efabe-f82f-454b-9da6-9cf5577e7b30 service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:49.633684 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867efabe-f82f-454b-9da6-9cf5577e7b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:49.642029 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867efabe-f82f-454b-9da6-9cf5577e7b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:49.643628 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867efabe-f82f-454b-9da6-9cf5577e7b30 service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:49.653620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 522/1039] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:50.538319 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6be12-acd5-4490-b48f-f09eb9a4b393 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:50.538894 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6be12-acd5-4490-b48f-f09eb9a4b393 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:50.538894 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6be12-acd5-4490-b48f-f09eb9a4b393 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:50.540250 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 518/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 17:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:50.545678 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce2ed-9f35-4594-8ceb-2c800bbd632f None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:50.546130 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce2ed-9f35-4594-8ceb-2c800bbd632f None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:50.546274 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce2ed-9f35-4594-8ceb-2c800bbd632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:50.565959 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-b54ce2ed-9f35-4594-8ceb-2c800bbd632f None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:50.567185 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-b54ce2ed-9f35-4594-8ceb-2c800bbd632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:50.574966 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 523/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 17:57:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:50.729859 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6be12-acd5-4490-b48f-f09eb9a4b393 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:50.743203 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6be12-acd5-4490-b48f-f09eb9a4b393 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:50.748091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbc792-9ad7-44ee-a9aa-2ccda59bb62c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:50.748697 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc792-9ad7-44ee-a9aa-2ccda59bb62c service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:50.748982 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc792-9ad7-44ee-a9aa-2ccda59bb62c service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:50.749261 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc792-9ad7-44ee-a9aa-2ccda59bb62c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:50.757263 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbc792-9ad7-44ee-a9aa-2ccda59bb62c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:50.758998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbc792-9ad7-44ee-a9aa-2ccda59bb62c service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:50.769176 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 519/1042] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:51.645177 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c529-b717-478d-a8e7-52fc59890c44 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:51.645773 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c529-b717-478d-a8e7-52fc59890c44 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:51.645773 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c529-b717-478d-a8e7-52fc59890c44 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:51.647126 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 524/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 17:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:51.652823 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b1b6-573d-4ea0-99af-c6d143ea1f93 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:51.653278 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b1b6-573d-4ea0-99af-c6d143ea1f93 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:51.653387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b1b6-573d-4ea0-99af-c6d143ea1f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:51.672876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-d936b1b6-573d-4ea0-99af-c6d143ea1f93 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:51.674088 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-d936b1b6-573d-4ea0-99af-c6d143ea1f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:51.681944 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 520/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 17:57:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:51.836216 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292c529-b717-478d-a8e7-52fc59890c44 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:51.850194 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292c529-b717-478d-a8e7-52fc59890c44 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:51.855135 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b717b7-3171-47b1-ba44-d5f964bc9f3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:51.855741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b717b7-3171-47b1-ba44-d5f964bc9f3b service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:51.856026 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b717b7-3171-47b1-ba44-d5f964bc9f3b service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:51.856306 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b717b7-3171-47b1-ba44-d5f964bc9f3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:51.864313 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b717b7-3171-47b1-ba44-d5f964bc9f3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:51.865891 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b717b7-3171-47b1-ba44-d5f964bc9f3b service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:51.875364 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 525/1045] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:52.679936 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd110a-63ba-48dd-90ab-ea5fbd9005e5 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:52.680360 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd110a-63ba-48dd-90ab-ea5fbd9005e5 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:52.680502 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd110a-63ba-48dd-90ab-ea5fbd9005e5 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:52.682299 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 521/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 17:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:52.687304 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63780001-de36-4381-b8e9-3c1b064cf287 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:52.687732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63780001-de36-4381-b8e9-3c1b064cf287 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:52.687856 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63780001-de36-4381-b8e9-3c1b064cf287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:52.707612 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-63780001-de36-4381-b8e9-3c1b064cf287 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:52.708807 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-63780001-de36-4381-b8e9-3c1b064cf287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:52.717027 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 526/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 17:57:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:52.873805 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd110a-63ba-48dd-90ab-ea5fbd9005e5 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:52.887888 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd110a-63ba-48dd-90ab-ea5fbd9005e5 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:52.892783 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd5980-7bdd-4b20-b14d-4e2c4348310e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:52.893386 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd5980-7bdd-4b20-b14d-4e2c4348310e service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:52.893671 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd5980-7bdd-4b20-b14d-4e2c4348310e service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:52.893948 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd5980-7bdd-4b20-b14d-4e2c4348310e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:52.902699 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd5980-7bdd-4b20-b14d-4e2c4348310e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:52.904262 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd5980-7bdd-4b20-b14d-4e2c4348310e service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:52.913580 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 522/1048] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:53.717609 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8492a-3ad4-417c-9ff7-1f0ffba3efcb None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:53.718115 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8492a-3ad4-417c-9ff7-1f0ffba3efcb None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:53.718225 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8492a-3ad4-417c-9ff7-1f0ffba3efcb None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:53.719564 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 527/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 17:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:53.724519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f44b5b-5f20-4266-811c-6620c5d3daa4 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:53.724942 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f44b5b-5f20-4266-811c-6620c5d3daa4 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:53.725088 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f44b5b-5f20-4266-811c-6620c5d3daa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:53.744843 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-71f44b5b-5f20-4266-811c-6620c5d3daa4 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:53.746049 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-71f44b5b-5f20-4266-811c-6620c5d3daa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:53.753778 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 523/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 17:57:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:53.915946 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8492a-3ad4-417c-9ff7-1f0ffba3efcb None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:53.929115 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8492a-3ad4-417c-9ff7-1f0ffba3efcb None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:53.934446 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2b0a1-45b3-497a-ac56-8a0959bfe503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:53.935072 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b0a1-45b3-497a-ac56-8a0959bfe503 service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:53.935351 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b0a1-45b3-497a-ac56-8a0959bfe503 service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:53.935627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b0a1-45b3-497a-ac56-8a0959bfe503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:53.943602 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2b0a1-45b3-497a-ac56-8a0959bfe503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:53.945179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2b0a1-45b3-497a-ac56-8a0959bfe503 service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:53.954968 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 528/1051] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:54.755779 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e8982-83e9-483b-a6a5-1f63e50d8304 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:54.756318 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e8982-83e9-483b-a6a5-1f63e50d8304 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:54.756318 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e8982-83e9-483b-a6a5-1f63e50d8304 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:54.757667 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 524/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 17:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:54.763328 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f419-b608-491e-9d33-af60dd2f6db9 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:54.763756 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f419-b608-491e-9d33-af60dd2f6db9 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:54.763882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f419-b608-491e-9d33-af60dd2f6db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:54.783896 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-cf29f419-b608-491e-9d33-af60dd2f6db9 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:54.785079 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-cf29f419-b608-491e-9d33-af60dd2f6db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:54.792833 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 529/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 17:57:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:54.953548 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e8982-83e9-483b-a6a5-1f63e50d8304 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:54.967390 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e8982-83e9-483b-a6a5-1f63e50d8304 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:54.972235 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e71bbd-a57a-4122-a530-b68adfff4e02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:54.972841 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e71bbd-a57a-4122-a530-b68adfff4e02 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:54.973125 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e71bbd-a57a-4122-a530-b68adfff4e02 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:54.973403 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e71bbd-a57a-4122-a530-b68adfff4e02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:54.981553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e71bbd-a57a-4122-a530-b68adfff4e02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:54.983168 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e71bbd-a57a-4122-a530-b68adfff4e02 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:54.992384 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 525/1054] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:55.810810 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e51f-1855-473a-8110-0d416cd9333c None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:55.811241 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e51f-1855-473a-8110-0d416cd9333c None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:55.811385 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e51f-1855-473a-8110-0d416cd9333c None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:55.812747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 530/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 17:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:55.817551 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a34f8f-374b-44f6-bb05-d06e7fab2ed9 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:55.817955 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a34f8f-374b-44f6-bb05-d06e7fab2ed9 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:55.818108 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a34f8f-374b-44f6-bb05-d06e7fab2ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:55.838122 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-63a34f8f-374b-44f6-bb05-d06e7fab2ed9 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:55.839568 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-63a34f8f-374b-44f6-bb05-d06e7fab2ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:55.847458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 526/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 17:57:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:56.000344 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e51f-1855-473a-8110-0d416cd9333c None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:56.014097 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e51f-1855-473a-8110-0d416cd9333c None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:56.018986 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59604924-2c9e-42f2-9923-9f9816ffe050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:56.019585 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59604924-2c9e-42f2-9923-9f9816ffe050 service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:56.019870 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59604924-2c9e-42f2-9923-9f9816ffe050 service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:56.020148 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59604924-2c9e-42f2-9923-9f9816ffe050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:56.028354 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59604924-2c9e-42f2-9923-9f9816ffe050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:56.029925 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59604924-2c9e-42f2-9923-9f9816ffe050 service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:56.039088 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 531/1057] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:57:58.208652 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f21f8-ee04-48c7-8af6-aa76ba91b505 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:58.209206 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f21f8-ee04-48c7-8af6-aa76ba91b505 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:58.209206 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f21f8-ee04-48c7-8af6-aa76ba91b505 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:58.210557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 527/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 17:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:57:58.216580 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8d392-ac40-468d-a8c1-8d2e6e4d879e None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:58.216983 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8d392-ac40-468d-a8c1-8d2e6e4d879e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:58.217158 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8d392-ac40-468d-a8c1-8d2e6e4d879e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:58.236497 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-81a8d392-ac40-468d-a8c1-8d2e6e4d879e None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:57:58.237702 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-81a8d392-ac40-468d-a8c1-8d2e6e4d879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:57:58.245676 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 532/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 17:57:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:57:58.285557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f21f8-ee04-48c7-8af6-aa76ba91b505 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:57:58.296742 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f21f8-ee04-48c7-8af6-aa76ba91b505 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:57:58.300169 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3b6f9-4068-4f06-b1cc-ac5729267092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:57:58.300764 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3b6f9-4068-4f06-b1cc-ac5729267092 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:57:58.301043 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3b6f9-4068-4f06-b1cc-ac5729267092 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:57:58.301313 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3b6f9-4068-4f06-b1cc-ac5729267092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:57:58.309993 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3b6f9-4068-4f06-b1cc-ac5729267092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:57:58.311434 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3b6f9-4068-4f06-b1cc-ac5729267092 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:57:58.320457 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 528/1060] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:57:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:00.682083 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90602364-c611-434a-88ec-7b929209ca98 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:00.682562 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90602364-c611-434a-88ec-7b929209ca98 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:00.682685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90602364-c611-434a-88ec-7b929209ca98 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:00.684048 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 533/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 17:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:00.689367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ad2e3-181c-4b0d-8ccc-050fd46246ed None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:00.689776 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ad2e3-181c-4b0d-8ccc-050fd46246ed None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:00.689923 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ad2e3-181c-4b0d-8ccc-050fd46246ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:00.709240 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-2b1ad2e3-181c-4b0d-8ccc-050fd46246ed None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:00.710458 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-2b1ad2e3-181c-4b0d-8ccc-050fd46246ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:00.718230 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 529/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 17:58:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:00.757655 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90602364-c611-434a-88ec-7b929209ca98 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:00.768433 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90602364-c611-434a-88ec-7b929209ca98 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:00.771916 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bb18c-f051-4bf6-9e16-860321ebd034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:00.772526 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb18c-f051-4bf6-9e16-860321ebd034 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:00.772810 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb18c-f051-4bf6-9e16-860321ebd034 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:00.773088 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb18c-f051-4bf6-9e16-860321ebd034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:00.782066 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bb18c-f051-4bf6-9e16-860321ebd034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:00.783528 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bb18c-f051-4bf6-9e16-860321ebd034 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:00.793597 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 534/1063] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:03.319049 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ac2c-ac99-4b95-ade0-b3f8091c8315 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:03.319615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ac2c-ac99-4b95-ade0-b3f8091c8315 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:03.319615 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ac2c-ac99-4b95-ade0-b3f8091c8315 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:03.320983 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 530/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 17:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:03.326800 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb64e92-7e32-4949-b241-8433b808b84e None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:03.327246 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb64e92-7e32-4949-b241-8433b808b84e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:03.327376 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb64e92-7e32-4949-b241-8433b808b84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:03.346573 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-dfb64e92-7e32-4949-b241-8433b808b84e None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:03.347760 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-dfb64e92-7e32-4949-b241-8433b808b84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:03.355575 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 535/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 17:58:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:03.397354 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0ac2c-ac99-4b95-ade0-b3f8091c8315 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:03.409195 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0ac2c-ac99-4b95-ade0-b3f8091c8315 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:03.412735 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f84fcd-9b9c-4447-ae8b-09b8d4359d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:03.413342 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f84fcd-9b9c-4447-ae8b-09b8d4359d94 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:03.413625 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f84fcd-9b9c-4447-ae8b-09b8d4359d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:03.413908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f84fcd-9b9c-4447-ae8b-09b8d4359d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:03.423061 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f84fcd-9b9c-4447-ae8b-09b8d4359d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:03.424487 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f84fcd-9b9c-4447-ae8b-09b8d4359d94 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:03.434367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 531/1066] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:05.825049 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9497e-469d-45e3-bd56-ec7a7ea0447e None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:05.825517 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9497e-469d-45e3-bd56-ec7a7ea0447e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:05.825630 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9497e-469d-45e3-bd56-ec7a7ea0447e None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:05.827023 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 536/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 17:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:05.832294 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf945-09f6-446c-833c-f692ce3ce5e8 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:05.832721 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf945-09f6-446c-833c-f692ce3ce5e8 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:05.832894 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf945-09f6-446c-833c-f692ce3ce5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:05.855370 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-deebf945-09f6-446c-833c-f692ce3ce5e8 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:05.856618 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-deebf945-09f6-446c-833c-f692ce3ce5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:05.864331 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 532/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 17:58:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:05.904102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9497e-469d-45e3-bd56-ec7a7ea0447e None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:05.914714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9497e-469d-45e3-bd56-ec7a7ea0447e None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:05.919251 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343e98d-1b06-4532-b39d-6bfa5f31f0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:05.919854 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343e98d-1b06-4532-b39d-6bfa5f31f0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:05.920139 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343e98d-1b06-4532-b39d-6bfa5f31f0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:05.920420 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343e98d-1b06-4532-b39d-6bfa5f31f0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:05.929176 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343e98d-1b06-4532-b39d-6bfa5f31f0c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:05.930628 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343e98d-1b06-4532-b39d-6bfa5f31f0c2 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:05.940667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 537/1069] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:08.232927 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfd7f6-8745-41b7-9d1a-cc51039cdc55 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:08.233463 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfd7f6-8745-41b7-9d1a-cc51039cdc55 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:08.233463 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfd7f6-8745-41b7-9d1a-cc51039cdc55 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:08.234874 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 533/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 17:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:08.240036 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8a203-22f4-443a-a1f4-e37172fb921d None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:08.240442 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8a203-22f4-443a-a1f4-e37172fb921d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:08.240606 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8a203-22f4-443a-a1f4-e37172fb921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:08.260256 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-35a8a203-22f4-443a-a1f4-e37172fb921d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:08.261456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-35a8a203-22f4-443a-a1f4-e37172fb921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:08.269147 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 538/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 17:58:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:08.309483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfd7f6-8745-41b7-9d1a-cc51039cdc55 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:08.319992 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfd7f6-8745-41b7-9d1a-cc51039cdc55 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:08.323530 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09f3cf-c900-412d-81c2-9cae8da518fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:08.324128 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09f3cf-c900-412d-81c2-9cae8da518fb service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:08.324406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09f3cf-c900-412d-81c2-9cae8da518fb service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:08.324681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09f3cf-c900-412d-81c2-9cae8da518fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:08.333281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09f3cf-c900-412d-81c2-9cae8da518fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:08.334723 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09f3cf-c900-412d-81c2-9cae8da518fb service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:08.343888 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 534/1072] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:10.739109 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac459b5-3bf2-41b7-a981-eeb4f9dc03b2 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:10.739620 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac459b5-3bf2-41b7-a981-eeb4f9dc03b2 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:10.739736 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac459b5-3bf2-41b7-a981-eeb4f9dc03b2 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:10.741044 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 539/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 17:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:10.746536 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fa52d-2364-405a-be38-6b0f3461416f None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:10.746942 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fa52d-2364-405a-be38-6b0f3461416f None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:10.747129 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fa52d-2364-405a-be38-6b0f3461416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:10.766754 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-d49fa52d-2364-405a-be38-6b0f3461416f None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:10.767965 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-d49fa52d-2364-405a-be38-6b0f3461416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:10.776640 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 535/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 17:58:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:10.816009 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac459b5-3bf2-41b7-a981-eeb4f9dc03b2 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:10.827375 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac459b5-3bf2-41b7-a981-eeb4f9dc03b2 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:10.830864 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3bc9d-d5e2-484e-8ee9-4e884db627cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:10.831472 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bc9d-d5e2-484e-8ee9-4e884db627cb service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:10.831748 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bc9d-d5e2-484e-8ee9-4e884db627cb service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:10.832021 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bc9d-d5e2-484e-8ee9-4e884db627cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:10.841329 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3bc9d-d5e2-484e-8ee9-4e884db627cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:10.842764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3bc9d-d5e2-484e-8ee9-4e884db627cb service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:10.851849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 540/1075] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:13.136385 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d31c1-c73f-4fa4-b086-af63876ec8d7 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:13.136958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d31c1-c73f-4fa4-b086-af63876ec8d7 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:13.136958 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d31c1-c73f-4fa4-b086-af63876ec8d7 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:13.138289 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 536/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 17:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:13.143459 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041b8ce-70b4-411e-8f69-650b9ac3fc4c None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:13.143863 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041b8ce-70b4-411e-8f69-650b9ac3fc4c None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:13.144024 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041b8ce-70b4-411e-8f69-650b9ac3fc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:13.152030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=70 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:58:13.164448 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-b041b8ce-70b4-411e-8f69-650b9ac3fc4c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:13.165703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-b041b8ce-70b4-411e-8f69-650b9ac3fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:13.173416 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 541/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 17:58:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:13.212600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d31c1-c73f-4fa4-b086-af63876ec8d7 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:13.218033 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=73 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:58:13.224371 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d31c1-c73f-4fa4-b086-af63876ec8d7 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:13.227919 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ad952-ae0a-4209-b3d9-2df9b97e393c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:13.228720 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ad952-ae0a-4209-b3d9-2df9b97e393c service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:13.228930 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ad952-ae0a-4209-b3d9-2df9b97e393c service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:13.229211 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ad952-ae0a-4209-b3d9-2df9b97e393c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:13.240478 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ad952-ae0a-4209-b3d9-2df9b97e393c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:13.244590 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ad952-ae0a-4209-b3d9-2df9b97e393c service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:13.254161 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 537/1078] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:15.538030 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a9340-d73a-4d6f-9091-a20f16e46ac8 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:15.538617 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a9340-d73a-4d6f-9091-a20f16e46ac8 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:15.538617 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a9340-d73a-4d6f-9091-a20f16e46ac8 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:15.539961 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 542/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 17:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:15.545175 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58228a5f-b861-400b-be44-8f8030541564 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:15.545600 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58228a5f-b861-400b-be44-8f8030541564 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:15.545739 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58228a5f-b861-400b-be44-8f8030541564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:15.565745 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-58228a5f-b861-400b-be44-8f8030541564 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:15.566989 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-58228a5f-b861-400b-be44-8f8030541564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:15.575536 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 538/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 17:58:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:15.613582 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a9340-d73a-4d6f-9091-a20f16e46ac8 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:15.624683 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a9340-d73a-4d6f-9091-a20f16e46ac8 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:15.628121 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba646f8d-d95e-4b43-bf34-8258f8050eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:15.628716 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba646f8d-d95e-4b43-bf34-8258f8050eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:15.628992 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba646f8d-d95e-4b43-bf34-8258f8050eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:15.629262 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba646f8d-d95e-4b43-bf34-8258f8050eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:15.638608 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba646f8d-d95e-4b43-bf34-8258f8050eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:15.640016 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba646f8d-d95e-4b43-bf34-8258f8050eb4 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:15.650117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 543/1081] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:17.872771 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f79fe6-c8d9-4c02-9eac-6dafcf9a7742 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:17.873310 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f79fe6-c8d9-4c02-9eac-6dafcf9a7742 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:17.873310 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f79fe6-c8d9-4c02-9eac-6dafcf9a7742 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:17.874707 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 539/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 17:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:17.879763 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d25b-152e-4a02-97a0-6066656b38dd None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:17.880189 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d25b-152e-4a02-97a0-6066656b38dd None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:17.880318 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d25b-152e-4a02-97a0-6066656b38dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:17.902019 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-6d98d25b-152e-4a02-97a0-6066656b38dd None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:17.903285 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-6d98d25b-152e-4a02-97a0-6066656b38dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:17.911284 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 544/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 17:58:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:17.950187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f79fe6-c8d9-4c02-9eac-6dafcf9a7742 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:17.960949 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f79fe6-c8d9-4c02-9eac-6dafcf9a7742 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:17.965207 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e13d0d-b35b-4612-b03f-6d7f18ff5806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:17.965814 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13d0d-b35b-4612-b03f-6d7f18ff5806 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:17.966096 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13d0d-b35b-4612-b03f-6d7f18ff5806 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:17.966371 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13d0d-b35b-4612-b03f-6d7f18ff5806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:17.975146 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e13d0d-b35b-4612-b03f-6d7f18ff5806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:17.976569 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e13d0d-b35b-4612-b03f-6d7f18ff5806 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:17.986573 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 540/1084] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:20.244763 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aca173-dc7f-4016-acac-c7406772da03 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:20.245325 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aca173-dc7f-4016-acac-c7406772da03 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:20.245325 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aca173-dc7f-4016-acac-c7406772da03 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:20.246732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 545/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 17:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:20.252105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9faab-86a9-4bf9-8241-9d9caf18c253 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:20.252504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9faab-86a9-4bf9-8241-9d9caf18c253 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:20.252663 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9faab-86a9-4bf9-8241-9d9caf18c253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:20.271298 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-42d9faab-86a9-4bf9-8241-9d9caf18c253 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:20.272491 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-42d9faab-86a9-4bf9-8241-9d9caf18c253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:20.280526 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 541/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 17:58:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:20.319073 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aca173-dc7f-4016-acac-c7406772da03 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:20.330332 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aca173-dc7f-4016-acac-c7406772da03 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:20.333807 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11400cac-4683-4f28-92db-9967cc0d0b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:20.334413 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11400cac-4683-4f28-92db-9967cc0d0b82 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:20.334730 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11400cac-4683-4f28-92db-9967cc0d0b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:20.335009 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11400cac-4683-4f28-92db-9967cc0d0b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:20.344121 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11400cac-4683-4f28-92db-9967cc0d0b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:20.345545 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11400cac-4683-4f28-92db-9967cc0d0b82 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:20.355587 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 546/1087] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:30.266650 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=17 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:58:30.350704 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=17 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:58:44.094824 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43840006-3180-4f80-abb5-d18fd3aa3ac8 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:44.095367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43840006-3180-4f80-abb5-d18fd3aa3ac8 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:44.095367 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43840006-3180-4f80-abb5-d18fd3aa3ac8 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:44.096737 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 542/1088] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:44.101928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154667f3-7b57-48d0-8d71-883cd930213e None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:44.102988 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154667f3-7b57-48d0-8d71-883cd930213e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:44.103197 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154667f3-7b57-48d0-8d71-883cd930213e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:44.122398 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-154667f3-7b57-48d0-8d71-883cd930213e None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:44.123625 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-154667f3-7b57-48d0-8d71-883cd930213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:44.131412 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 547/1089] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:58:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 17:58:44.180966 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715f157-3d0c-44cd-bc69-4245eb371590 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:44.181251 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715f157-3d0c-44cd-bc69-4245eb371590 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:44.181550 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715f157-3d0c-44cd-bc69-4245eb371590 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:44.182920 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 543/1090] 10.222.0.73 () {54 vars in 966 bytes} [Wed Jul 27 17:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:44.187964 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab096b7-c0f0-4edd-abf8-110bc80f7398 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:44.188257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab096b7-c0f0-4edd-abf8-110bc80f7398 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:44.188540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab096b7-c0f0-4edd-abf8-110bc80f7398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:44.207584 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-3ab096b7-c0f0-4edd-abf8-110bc80f7398 None None] MFA Rules not processed for user `dd0601985b76490dae3f9d0ce2fe9505`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:44.208772 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-3ab096b7-c0f0-4edd-abf8-110bc80f7398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:44.215710 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 548/1091] 10.222.0.73 () {58 vars in 1063 bytes} [Wed Jul 27 17:58:44 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:44.222706 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715f157-3d0c-44cd-bc69-4245eb371590 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:44.233751 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715f157-3d0c-44cd-bc69-4245eb371590 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:44.237182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38dfa0-116b-4f29-a5d2-846d0b3d77f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0601985b76490dae3f9d0ce2fe9505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:44.237751 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38dfa0-116b-4f29-a5d2-846d0b3d77f3 service glance] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:44.238031 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38dfa0-116b-4f29-a5d2-846d0b3d77f3 service glance] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:44.238302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38dfa0-116b-4f29-a5d2-846d0b3d77f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:44.247035 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38dfa0-116b-4f29-a5d2-846d0b3d77f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:44.248452 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38dfa0-116b-4f29-a5d2-846d0b3d77f3 service glance] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:44.257476 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 544/1092] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:46.599095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af433a-4a5c-4354-b1e6-c9983d2a14a5 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:46.599652 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af433a-4a5c-4354-b1e6-c9983d2a14a5 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:46.599652 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af433a-4a5c-4354-b1e6-c9983d2a14a5 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:46.600989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 549/1093] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:46.606522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec45f98-fcff-4be5-954d-8c43ca8d076a None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:46.606959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec45f98-fcff-4be5-954d-8c43ca8d076a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:46.607105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec45f98-fcff-4be5-954d-8c43ca8d076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:46.627011 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-aec45f98-fcff-4be5-954d-8c43ca8d076a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:46.628214 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-aec45f98-fcff-4be5-954d-8c43ca8d076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:46.636456 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 545/1094] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:58:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 17:58:46.662833 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af433a-4a5c-4354-b1e6-c9983d2a14a5 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:46.675166 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af433a-4a5c-4354-b1e6-c9983d2a14a5 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:46.679496 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df6c9e-01dd-4b28-8097-aa50288695be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:46.680095 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df6c9e-01dd-4b28-8097-aa50288695be admin admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:46.680401 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df6c9e-01dd-4b28-8097-aa50288695be admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:46.680680 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df6c9e-01dd-4b28-8097-aa50288695be admin admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:46.681470 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df6c9e-01dd-4b28-8097-aa50288695be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:46.683267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: WARNING py.warnings [None req-c1df6c9e-01dd-4b28-8097-aa50288695be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 17:58:46.683267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: warnings.warn(msg) Jul 27 17:58:46.683267 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: Jul 27 17:58:46.684402 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df6c9e-01dd-4b28-8097-aa50288695be admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:46.703406 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 550/1095] 10.222.0.73 () {56 vars in 1108 bytes} [Wed Jul 27 17:58:46 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 17:58:48.964132 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa605b3-85be-4d2f-b776-209135b635ed None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:48.964662 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa605b3-85be-4d2f-b776-209135b635ed None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:48.964662 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa605b3-85be-4d2f-b776-209135b635ed None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:48.965929 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 546/1096] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 17:58:48.971327 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6351ac1-034a-401b-8ece-e6202721913c None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:48.971747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6351ac1-034a-401b-8ece-e6202721913c None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:48.971879 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6351ac1-034a-401b-8ece-e6202721913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:48.991110 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-d6351ac1-034a-401b-8ece-e6202721913c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:48.992292 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-d6351ac1-034a-401b-8ece-e6202721913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:49.000591 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 551/1097] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:58:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:49.046594 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa605b3-85be-4d2f-b776-209135b635ed None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:49.060728 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa605b3-85be-4d2f-b776-209135b635ed None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:49.065557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f70a9-d1d6-423c-814b-532846d7fe60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:49.066160 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f70a9-d1d6-423c-814b-532846d7fe60 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:49.066441 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f70a9-d1d6-423c-814b-532846d7fe60 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:49.066747 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f70a9-d1d6-423c-814b-532846d7fe60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:49.074641 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f70a9-d1d6-423c-814b-532846d7fe60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:49.076210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f70a9-d1d6-423c-814b-532846d7fe60 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:49.085333 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 547/1098] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:51.501177 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54975053-084d-48c4-a13f-edc549b61efb None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:51.501705 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54975053-084d-48c4-a13f-edc549b61efb None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:51.501705 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54975053-084d-48c4-a13f-edc549b61efb None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:51.503054 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 552/1099] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:51.508192 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a5dc-3ca0-46ca-b2f7-65b0c861539d None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:51.509187 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a5dc-3ca0-46ca-b2f7-65b0c861539d None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:51.509349 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a5dc-3ca0-46ca-b2f7-65b0c861539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:51.528579 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-d412a5dc-3ca0-46ca-b2f7-65b0c861539d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:51.529756 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-d412a5dc-3ca0-46ca-b2f7-65b0c861539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:51.537340 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 548/1100] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:58:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 17:58:51.577554 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54975053-084d-48c4-a13f-edc549b61efb None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:51.588685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54975053-084d-48c4-a13f-edc549b61efb None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:51.592125 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae6e9a-ec01-4b81-933b-9fcc6fd7a38a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:51.592732 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae6e9a-ec01-4b81-933b-9fcc6fd7a38a service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:51.593020 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae6e9a-ec01-4b81-933b-9fcc6fd7a38a service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:51.593297 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae6e9a-ec01-4b81-933b-9fcc6fd7a38a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:51.601938 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae6e9a-ec01-4b81-933b-9fcc6fd7a38a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:51.604148 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae6e9a-ec01-4b81-933b-9fcc6fd7a38a service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:51.613417 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 553/1101] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:53.902945 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb5ea-0717-4dee-8868-8f8bf4c2b580 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:53.903520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb5ea-0717-4dee-8868-8f8bf4c2b580 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:53.903520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb5ea-0717-4dee-8868-8f8bf4c2b580 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:53.904910 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 549/1102] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:53.909974 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e249a-621f-45cd-8eae-9ed0d7eff120 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:53.910426 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e249a-621f-45cd-8eae-9ed0d7eff120 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:53.910582 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e249a-621f-45cd-8eae-9ed0d7eff120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:53.929145 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-941e249a-621f-45cd-8eae-9ed0d7eff120 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:53.930924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-941e249a-621f-45cd-8eae-9ed0d7eff120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:53.938607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 554/1103] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:58:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:53.977981 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fb5ea-0717-4dee-8868-8f8bf4c2b580 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:53.988460 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fb5ea-0717-4dee-8868-8f8bf4c2b580 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:53.991895 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099bf19-867d-4404-80fe-9ad0caae2f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:53.992526 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099bf19-867d-4404-80fe-9ad0caae2f95 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:53.993384 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099bf19-867d-4404-80fe-9ad0caae2f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:53.993653 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099bf19-867d-4404-80fe-9ad0caae2f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:54.002654 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099bf19-867d-4404-80fe-9ad0caae2f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:54.004087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099bf19-867d-4404-80fe-9ad0caae2f95 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:54.013364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 550/1104] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:56.319509 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699ce1-581c-48c1-80a8-5e7da933c4a7 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:56.320067 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699ce1-581c-48c1-80a8-5e7da933c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:56.320067 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699ce1-581c-48c1-80a8-5e7da933c4a7 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:56.321490 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 555/1105] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:56.326625 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497ddc3-7fe4-44b1-b232-c0c92033ae8b None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:56.327018 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497ddc3-7fe4-44b1-b232-c0c92033ae8b None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:56.327190 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497ddc3-7fe4-44b1-b232-c0c92033ae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:56.346198 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-3497ddc3-7fe4-44b1-b232-c0c92033ae8b None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:56.347472 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-3497ddc3-7fe4-44b1-b232-c0c92033ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:56.356069 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 551/1106] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:58:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:56.397381 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699ce1-581c-48c1-80a8-5e7da933c4a7 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:56.408259 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699ce1-581c-48c1-80a8-5e7da933c4a7 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:56.412315 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ae114-ad83-45bd-b834-5f0bb768bebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:56.412928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae114-ad83-45bd-b834-5f0bb768bebe service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:56.413212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae114-ad83-45bd-b834-5f0bb768bebe service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:56.413492 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae114-ad83-45bd-b834-5f0bb768bebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:56.423110 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ae114-ad83-45bd-b834-5f0bb768bebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:56.424527 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ae114-ad83-45bd-b834-5f0bb768bebe service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:56.434566 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 556/1107] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:58:58.853520 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3fb4-5446-47df-bc69-20cda95c722e None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:58.854076 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3fb4-5446-47df-bc69-20cda95c722e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:58.854076 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3fb4-5446-47df-bc69-20cda95c722e None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:58.855430 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 552/1108] 10.222.0.73 () {54 vars in 926 bytes} [Wed Jul 27 17:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 17:58:58.861271 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49543e-547a-4773-847a-ed39f8539fdf None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:58.861734 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49543e-547a-4773-847a-ed39f8539fdf None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:58.861839 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49543e-547a-4773-847a-ed39f8539fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:58.880793 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-6f49543e-547a-4773-847a-ed39f8539fdf None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 17:58:58.881991 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-6f49543e-547a-4773-847a-ed39f8539fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 17:58:58.890106 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 557/1109] 10.222.0.73 () {58 vars in 1023 bytes} [Wed Jul 27 17:58:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 17:58:58.931204 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3fb4-5446-47df-bc69-20cda95c722e None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 17:58:58.941724 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3fb4-5446-47df-bc69-20cda95c722e None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 17:58:58.945128 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706b13d-9300-432f-9344-41e99b1d6089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 17:58:58.945724 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706b13d-9300-432f-9344-41e99b1d6089 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 17:58:58.946035 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706b13d-9300-432f-9344-41e99b1d6089 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 17:58:58.946307 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706b13d-9300-432f-9344-41e99b1d6089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 17:58:58.954964 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706b13d-9300-432f-9344-41e99b1d6089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 17:58:58.956315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706b13d-9300-432f-9344-41e99b1d6089 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 17:58:58.965962 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 553/1110] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 17:58:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 17:59:08.876115 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=33 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 17:59:08.961492 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=33 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:00:28.541950 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0dc89-af43-404a-91db-6a6a8b57f69a None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:28.542607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0dc89-af43-404a-91db-6a6a8b57f69a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:28.542607 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0dc89-af43-404a-91db-6a6a8b57f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:28.562920 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-84e0dc89-af43-404a-91db-6a6a8b57f69a None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:00:28.564117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-84e0dc89-af43-404a-91db-6a6a8b57f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:00:28.571760 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 558/1111] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:00:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:00:28.579738 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868c16a-5fba-4f68-8b5d-6fb1c70ce247 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:28.580245 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868c16a-5fba-4f68-8b5d-6fb1c70ce247 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:28.580357 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868c16a-5fba-4f68-8b5d-6fb1c70ce247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:28.599059 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-9868c16a-5fba-4f68-8b5d-6fb1c70ce247 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:00:28.600251 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-9868c16a-5fba-4f68-8b5d-6fb1c70ce247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:00:28.608689 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 554/1112] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:00:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:00:28.613112 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0dc89-af43-404a-91db-6a6a8b57f69a None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:00:28.623194 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0dc89-af43-404a-91db-6a6a8b57f69a None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:00:28.627650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927069de-00e8-49a6-a6b8-b4ad10b76c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:00:28.628252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927069de-00e8-49a6-a6b8-b4ad10b76c42 admin admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:28.628534 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927069de-00e8-49a6-a6b8-b4ad10b76c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:28.628809 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927069de-00e8-49a6-a6b8-b4ad10b76c42 admin admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:28.629497 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927069de-00e8-49a6-a6b8-b4ad10b76c42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:00:28.629802 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927069de-00e8-49a6-a6b8-b4ad10b76c42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:00:28.630843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: WARNING py.warnings [None req-927069de-00e8-49a6-a6b8-b4ad10b76c42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:00:28.630843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: warnings.warn(msg) Jul 27 18:00:28.630843 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: Jul 27 18:00:28.631728 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927069de-00e8-49a6-a6b8-b4ad10b76c42 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:00:28.643058 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 559/1113] 10.222.0.73 () {58 vars in 1153 bytes} [Wed Jul 27 18:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:00:28.651085 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868c16a-5fba-4f68-8b5d-6fb1c70ce247 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:00:28.660664 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868c16a-5fba-4f68-8b5d-6fb1c70ce247 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:00:28.665802 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a07d90-5a20-4f58-8214-0b47e3fb7829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:00:28.666410 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a07d90-5a20-4f58-8214-0b47e3fb7829 admin admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:28.666757 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a07d90-5a20-4f58-8214-0b47e3fb7829 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:28.667034 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a07d90-5a20-4f58-8214-0b47e3fb7829 admin admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:28.667714 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a07d90-5a20-4f58-8214-0b47e3fb7829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:00:28.669472 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: WARNING py.warnings [None req-a5a07d90-5a20-4f58-8214-0b47e3fb7829 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:00:28.669472 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: warnings.warn(msg) Jul 27 18:00:28.669472 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: Jul 27 18:00:28.670745 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a07d90-5a20-4f58-8214-0b47e3fb7829 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:00:28.700702 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 555/1114] 10.222.0.73 () {60 vars in 1153 bytes} [Wed Jul 27 18:00:28 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:00:28.704891 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927069de-00e8-49a6-a6b8-b4ad10b76c42 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:00:28.714882 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927069de-00e8-49a6-a6b8-b4ad10b76c42 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:00:28.770179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd827594-6e37-4c2a-b1af-2620a603d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:00:28.770834 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd827594-6e37-4c2a-b1af-2620a603d1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:28.771119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd827594-6e37-4c2a-b1af-2620a603d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:28.771396 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd827594-6e37-4c2a-b1af-2620a603d1c1 admin admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:28.772073 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd827594-6e37-4c2a-b1af-2620a603d1c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:00:28.773117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: WARNING py.warnings [None req-fd827594-6e37-4c2a-b1af-2620a603d1c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:00:28.773117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: warnings.warn(msg) Jul 27 18:00:28.773117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: Jul 27 18:00:28.774601 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd827594-6e37-4c2a-b1af-2620a603d1c1 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:00:28.800221 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 560/1115] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 18:00:28 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:00:28.801445 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a07d90-5a20-4f58-8214-0b47e3fb7829 admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:00:28.812399 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a07d90-5a20-4f58-8214-0b47e3fb7829 admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:00:28.817108 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bdc88-46b2-423f-894c-a88dc672666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:00:28.817719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bdc88-46b2-423f-894c-a88dc672666d admin admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:28.818006 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bdc88-46b2-423f-894c-a88dc672666d admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:28.818280 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bdc88-46b2-423f-894c-a88dc672666d admin admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:28.819093 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bdc88-46b2-423f-894c-a88dc672666d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:00:28.820127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: WARNING py.warnings [None req-556bdc88-46b2-423f-894c-a88dc672666d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:00:28.820127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: warnings.warn(msg) Jul 27 18:00:28.820127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: Jul 27 18:00:28.820995 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bdc88-46b2-423f-894c-a88dc672666d admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:00:28.833491 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 556/1116] 10.222.0.73 () {58 vars in 1122 bytes} [Wed Jul 27 18:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:00:28.838196 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd827594-6e37-4c2a-b1af-2620a603d1c1 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:00:28.848099 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd827594-6e37-4c2a-b1af-2620a603d1c1 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:00:28.853293 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875201d-440f-42ca-9002-bf694b83fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:00:28.853926 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875201d-440f-42ca-9002-bf694b83fc20 admin admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:28.854197 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875201d-440f-42ca-9002-bf694b83fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:28.854479 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875201d-440f-42ca-9002-bf694b83fc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:28.855200 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875201d-440f-42ca-9002-bf694b83fc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:00:28.856213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: WARNING py.warnings [None req-6875201d-440f-42ca-9002-bf694b83fc20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:00:28.856213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: warnings.warn(msg) Jul 27 18:00:28.856213 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: Jul 27 18:00:28.857114 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875201d-440f-42ca-9002-bf694b83fc20 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:00:28.870601 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 561/1117] 10.222.0.73 () {58 vars in 1122 bytes} [Wed Jul 27 18:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:00:28.874678 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bdc88-46b2-423f-894c-a88dc672666d admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:00:28.884396 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bdc88-46b2-423f-894c-a88dc672666d admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:00:28.888927 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacc8cd-720d-4cfa-ab0a-bfb64c548f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:00:28.889584 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacc8cd-720d-4cfa-ab0a-bfb64c548f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:28.889874 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacc8cd-720d-4cfa-ab0a-bfb64c548f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:28.890152 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacc8cd-720d-4cfa-ab0a-bfb64c548f57 admin admin] PATH_INFO: `/v3/projects/9604831eae97457686d36ab53acf1d47/users/f8908aa99251480eb77a52e2fa7024d6/roles/a2eb0e476c1f497888d73bb1d1771d16` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:28.905200 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacc8cd-720d-4cfa-ab0a-bfb64c548f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9604831eae97457686d36ab53acf1d47, user_id=f8908aa99251480eb77a52e2fa7024d6, role_id=a2eb0e476c1f497888d73bb1d1771d16)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:00:28.906252 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: WARNING py.warnings [None req-2dacc8cd-720d-4cfa-ab0a-bfb64c548f57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:00:28.906252 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: warnings.warn(msg) Jul 27 18:00:28.906252 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: Jul 27 18:00:28.908202 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacc8cd-720d-4cfa-ab0a-bfb64c548f57 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:00:28.921114 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 557/1118] 10.222.0.73 () {60 vars in 1483 bytes} [Wed Jul 27 18:00:28 2022] PUT /identity/v3/projects/9604831eae97457686d36ab53acf1d47/users/f8908aa99251480eb77a52e2fa7024d6/roles/a2eb0e476c1f497888d73bb1d1771d16 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:00:28.933812 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6002c-e33e-4543-8573-3d3659d969d2 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:28.934108 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6002c-e33e-4543-8573-3d3659d969d2 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:28.934389 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6002c-e33e-4543-8573-3d3659d969d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:28.962020 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-bcb6002c-e33e-4543-8573-3d3659d969d2 None None] MFA Rules not processed for user `f8908aa99251480eb77a52e2fa7024d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:00:28.963253 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-bcb6002c-e33e-4543-8573-3d3659d969d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:00:29.025343 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 562/1119] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:00:28 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:00:29.038557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154fd52-df6e-4db8-81ba-013d4ed84ccd None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:29.038876 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154fd52-df6e-4db8-81ba-013d4ed84ccd None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:29.039397 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154fd52-df6e-4db8-81ba-013d4ed84ccd None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:29.040781 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 558/1120] 10.222.0.73 () {54 vars in 964 bytes} [Wed Jul 27 18:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:00:29.045915 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41039fa4-d835-4fe4-8c2a-1739feff748e None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:29.046152 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41039fa4-d835-4fe4-8c2a-1739feff748e None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:29.046439 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41039fa4-d835-4fe4-8c2a-1739feff748e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:29.067206 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-41039fa4-d835-4fe4-8c2a-1739feff748e None None] MFA Rules not processed for user `856e3f650ab34f15828f1adb320d03ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:00:29.068441 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-41039fa4-d835-4fe4-8c2a-1739feff748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:00:29.111590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:00:29.120503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 563/1121] 10.222.0.73 () {58 vars in 1061 bytes} [Wed Jul 27 18:00:29 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:00:29.128087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154fd52-df6e-4db8-81ba-013d4ed84ccd None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:00:29.139359 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154fd52-df6e-4db8-81ba-013d4ed84ccd None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:00:29.142874 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea16c95-b58e-49e1-8934-f7144e62ee90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856e3f650ab34f15828f1adb320d03ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:00:29.143478 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16c95-b58e-49e1-8934-f7144e62ee90 service cinder] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:29.143791 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16c95-b58e-49e1-8934-f7144e62ee90 service cinder] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:29.144072 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16c95-b58e-49e1-8934-f7144e62ee90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:29.152575 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea16c95-b58e-49e1-8934-f7144e62ee90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:00:29.154020 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea16c95-b58e-49e1-8934-f7144e62ee90 service cinder] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:00:29.162881 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 559/1122] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:00:29 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:00:29.201486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311245c-e98e-4443-a7b9-3828ba5fa7d1 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:29.201775 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311245c-e98e-4443-a7b9-3828ba5fa7d1 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:29.202051 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311245c-e98e-4443-a7b9-3828ba5fa7d1 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:29.203368 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 564/1123] 10.222.0.73 () {52 vars in 830 bytes} [Wed Jul 27 18:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:00:29.206911 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea16c95-b58e-49e1-8934-f7144e62ee90 service cinder] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:00:29.268364 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea16c95-b58e-49e1-8934-f7144e62ee90 service cinder] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:00:29.272967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:00:29.274258 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:29.274556 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:29.274840 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] PATH_INFO: `/v3/users/f8908aa99251480eb77a52e2fa7024d6` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:29.276027 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8908aa99251480eb77a52e2fa7024d6)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:00:29.277062 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: WARNING py.warnings [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:00:29.277062 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: warnings.warn(msg) Jul 27 18:00:29.277062 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: Jul 27 18:00:29.278531 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:00:29.341394 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8908aa99251480eb77a52e2fa7024d6'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:00:29.359967 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8908aa99251480eb77a52e2fa7024d6'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:00:29.360744 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8908aa99251480eb77a52e2fa7024d6'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:00:29.361362 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8908aa99251480eb77a52e2fa7024d6'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:00:29.370856 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8908aa99251480eb77a52e2fa7024d6'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:00:29.390357 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 560/1124] 10.222.0.73 () {58 vars in 1224 bytes} [Wed Jul 27 18:00:29 2022] DELETE /identity/v3/users/f8908aa99251480eb77a52e2fa7024d6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:00:29.394837 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96efc9-380f-4337-8879-496ffa9f29a6 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:29.395127 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96efc9-380f-4337-8879-496ffa9f29a6 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:29.395407 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96efc9-380f-4337-8879-496ffa9f29a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:29.414851 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-bd96efc9-380f-4337-8879-496ffa9f29a6 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:00:29.416042 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-bd96efc9-380f-4337-8879-496ffa9f29a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:00:29.474524 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 565/1125] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:00:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:00:29.484712 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:00:29.486137 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:00:29.491496 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:00:29.545353 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27135fa5-ece1-4123-aed9-89e45044cec6 admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:00:29.549012 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81826b7-4b2b-4541-a9a5-45fa3beb490e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:00:29.549685 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81826b7-4b2b-4541-a9a5-45fa3beb490e service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:29.549975 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81826b7-4b2b-4541-a9a5-45fa3beb490e service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:29.550259 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81826b7-4b2b-4541-a9a5-45fa3beb490e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:29.559681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81826b7-4b2b-4541-a9a5-45fa3beb490e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:00:29.561116 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81826b7-4b2b-4541-a9a5-45fa3beb490e service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:00:29.571127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 561/1126] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:00:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:00:29.895069 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96efc9-380f-4337-8879-496ffa9f29a6 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:00:29.896564 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-bd96efc9-380f-4337-8879-496ffa9f29a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:00:29.908810 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96efc9-380f-4337-8879-496ffa9f29a6 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:00:29.913379 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:00:29.914105 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:00:29.914399 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:00:29.914713 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] PATH_INFO: `/v3/projects/9604831eae97457686d36ab53acf1d47` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:00:29.915886 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9604831eae97457686d36ab53acf1d47)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:00:29.916930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: WARNING py.warnings [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:00:29.916930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: warnings.warn(msg) Jul 27 18:00:29.916930 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: Jul 27 18:00:29.918092 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:00:29.981957 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9604831eae97457686d36ab53acf1d47', 'request_id': 'req-8526b358-30a4-4e77-8f16-c3643911f8a0'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:00:29.988078 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9604831eae97457686d36ab53acf1d47', 'request_id': 'req-8526b358-30a4-4e77-8f16-c3643911f8a0'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:00:29.998143 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9604831eae97457686d36ab53acf1d47', 'request_id': 'req-8526b358-30a4-4e77-8f16-c3643911f8a0'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:00:30.016068 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] The token cache is being invalidate because project 9604831eae97457686d36ab53acf1d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:00:30.016357 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:00:30.017078 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-8526b358-30a4-4e77-8f16-c3643911f8a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:00:30.018619 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 566/1127] 10.222.0.73 () {58 vars in 1233 bytes} [Wed Jul 27 18:00:29 2022] DELETE /identity/v3/projects/9604831eae97457686d36ab53acf1d47 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:00:39.566371 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=25 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:00:40.013098 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:01:51.141435 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaefad-4968-4499-bc09-8cea67557d69 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:01:51.142026 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaefad-4968-4499-bc09-8cea67557d69 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:01:51.142026 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaefad-4968-4499-bc09-8cea67557d69 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:01:51.143382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 562/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:01:51.148323 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe835058-47dc-4efc-980f-2e95da7f17db None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:01:51.148718 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe835058-47dc-4efc-980f-2e95da7f17db None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:01:51.148888 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe835058-47dc-4efc-980f-2e95da7f17db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:01:51.217511 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-fe835058-47dc-4efc-980f-2e95da7f17db None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:01:51.218778 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-fe835058-47dc-4efc-980f-2e95da7f17db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:01:51.312705 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 567/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:01:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:01:51.471662 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaefad-4968-4499-bc09-8cea67557d69 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:01:51.473378 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-8abaefad-4968-4499-bc09-8cea67557d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:01:51.566462 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaefad-4968-4499-bc09-8cea67557d69 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:01:51.572314 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca799b6b-ad89-4216-8552-824561a57f6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:01:51.572932 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca799b6b-ad89-4216-8552-824561a57f6f service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:01:51.573215 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca799b6b-ad89-4216-8552-824561a57f6f service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:01:51.573493 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca799b6b-ad89-4216-8552-824561a57f6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:01:51.581528 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca799b6b-ad89-4216-8552-824561a57f6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:01:51.583146 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca799b6b-ad89-4216-8552-824561a57f6f service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:01:51.592585 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 563/1130] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:01:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:01:52.422778 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4578b4-d62a-40ef-81a7-07bbf306b6b4 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:01:52.423322 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4578b4-d62a-40ef-81a7-07bbf306b6b4 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:01:52.423322 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4578b4-d62a-40ef-81a7-07bbf306b6b4 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:01:52.424679 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 568/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:01:52.429433 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f771-e72d-4810-b61b-3d59cea28c78 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:01:52.429851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f771-e72d-4810-b61b-3d59cea28c78 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:01:52.429981 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f771-e72d-4810-b61b-3d59cea28c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:01:52.451393 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-b300f771-e72d-4810-b61b-3d59cea28c78 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:01:52.452631 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-b300f771-e72d-4810-b61b-3d59cea28c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:01:52.460565 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 564/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:01:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:01:52.623407 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4578b4-d62a-40ef-81a7-07bbf306b6b4 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:01:52.637059 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4578b4-d62a-40ef-81a7-07bbf306b6b4 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:01:52.642063 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa306815-37f1-46c5-bc59-64ddc0243bc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:01:52.642707 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306815-37f1-46c5-bc59-64ddc0243bc8 service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:01:52.642997 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306815-37f1-46c5-bc59-64ddc0243bc8 service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:01:52.643316 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306815-37f1-46c5-bc59-64ddc0243bc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:01:52.652082 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa306815-37f1-46c5-bc59-64ddc0243bc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:01:52.653656 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa306815-37f1-46c5-bc59-64ddc0243bc8 service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:01:52.663388 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 569/1133] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:01:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:01:56.896978 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6e1d-0f01-45e8-98e7-7caf9707665c None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:01:56.897527 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6e1d-0f01-45e8-98e7-7caf9707665c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:01:56.897527 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6e1d-0f01-45e8-98e7-7caf9707665c None None] PATH_INFO: `/v3` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:01:56.898866 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 565/1134] 10.222.0.42 () {54 vars in 925 bytes} [Wed Jul 27 18:01:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:01:56.904434 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb952-176d-4fa8-85ef-a72367408650 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:01:56.905094 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb952-176d-4fa8-85ef-a72367408650 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:01:56.905266 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb952-176d-4fa8-85ef-a72367408650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:01:56.936320 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-6fadb952-176d-4fa8-85ef-a72367408650 None None] MFA Rules not processed for user `5144a9d861f8482a8f31abc1315fe818`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:01:56.937528 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-6fadb952-176d-4fa8-85ef-a72367408650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:01:57.119364 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:01:57.129214 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 570/1135] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Jul 27 18:01:56 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:02:01.094931 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1995d14-031e-467e-b660-2d687ec15a41 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:01.095477 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1995d14-031e-467e-b660-2d687ec15a41 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:01.095477 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1995d14-031e-467e-b660-2d687ec15a41 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:01.096834 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 566/1136] 10.222.0.73 () {54 vars in 961 bytes} [Wed Jul 27 18:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:02:01.101935 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1094a-c876-4ec0-b7c8-eca29d5dd268 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:01.102928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1094a-c876-4ec0-b7c8-eca29d5dd268 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:01.103148 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1094a-c876-4ec0-b7c8-eca29d5dd268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:01.122137 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-83d1094a-c876-4ec0-b7c8-eca29d5dd268 None None] MFA Rules not processed for user `5144a9d861f8482a8f31abc1315fe818`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:02:01.123363 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-83d1094a-c876-4ec0-b7c8-eca29d5dd268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:02:01.131962 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 571/1137] 10.222.0.73 () {58 vars in 1058 bytes} [Wed Jul 27 18:02:01 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:02:01.139257 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1995d14-031e-467e-b660-2d687ec15a41 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:02:01.153118 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1995d14-031e-467e-b660-2d687ec15a41 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:02:01.158223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80585e6c-4e7e-435a-87da-4bd45d19d0e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5144a9d861f8482a8f31abc1315fe818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:02:01.158858 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80585e6c-4e7e-435a-87da-4bd45d19d0e7 service placement] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:01.159146 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80585e6c-4e7e-435a-87da-4bd45d19d0e7 service placement] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:01.159423 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80585e6c-4e7e-435a-87da-4bd45d19d0e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:01.168150 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80585e6c-4e7e-435a-87da-4bd45d19d0e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:02:01.169741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80585e6c-4e7e-435a-87da-4bd45d19d0e7 service placement] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:02:01.179331 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 567/1138] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:02:01 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:02:03.898486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97850f57-2091-4c55-b1ae-00dd1029dce4 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:03.899070 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97850f57-2091-4c55-b1ae-00dd1029dce4 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:03.899070 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97850f57-2091-4c55-b1ae-00dd1029dce4 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:03.901017 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 572/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:02:03.905915 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc438ac-07fb-46d2-b20f-69ceb63e39df None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:03.906350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc438ac-07fb-46d2-b20f-69ceb63e39df None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:03.906532 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc438ac-07fb-46d2-b20f-69ceb63e39df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:03.925894 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-0dc438ac-07fb-46d2-b20f-69ceb63e39df None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:02:03.927143 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-0dc438ac-07fb-46d2-b20f-69ceb63e39df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:02:03.934892 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 568/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:02:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:02:04.097185 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97850f57-2091-4c55-b1ae-00dd1029dce4 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:02:04.111517 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97850f57-2091-4c55-b1ae-00dd1029dce4 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:02:04.116385 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eadd5-b4b2-4c3e-9c21-c0dddd5ded78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:02:04.116989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eadd5-b4b2-4c3e-9c21-c0dddd5ded78 service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:04.117275 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eadd5-b4b2-4c3e-9c21-c0dddd5ded78 service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:04.117554 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eadd5-b4b2-4c3e-9c21-c0dddd5ded78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:04.125621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eadd5-b4b2-4c3e-9c21-c0dddd5ded78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:02:04.127254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eadd5-b4b2-4c3e-9c21-c0dddd5ded78 service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:02:04.136650 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 573/1141] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:02:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:02:04.981288 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a1d0a-7a2b-4268-af3c-f63318a9c54c None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:04.981835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a1d0a-7a2b-4268-af3c-f63318a9c54c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:04.981835 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a1d0a-7a2b-4268-af3c-f63318a9c54c None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:04.983227 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 569/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:02:04.988025 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575e147-80e6-4a57-9620-dbeff7c6cded None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:04.988479 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575e147-80e6-4a57-9620-dbeff7c6cded None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:04.988586 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575e147-80e6-4a57-9620-dbeff7c6cded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:05.009166 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-8575e147-80e6-4a57-9620-dbeff7c6cded None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:02:05.010586 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-8575e147-80e6-4a57-9620-dbeff7c6cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:02:05.018304 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 574/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:02:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:02:05.178836 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a1d0a-7a2b-4268-af3c-f63318a9c54c None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:02:05.192582 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a1d0a-7a2b-4268-af3c-f63318a9c54c None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:02:05.197991 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e917703-84e1-487a-a71b-a3d7f620d458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:02:05.198655 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e917703-84e1-487a-a71b-a3d7f620d458 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:05.198938 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e917703-84e1-487a-a71b-a3d7f620d458 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:05.199214 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e917703-84e1-487a-a71b-a3d7f620d458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:05.207131 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e917703-84e1-487a-a71b-a3d7f620d458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:02:05.208711 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e917703-84e1-487a-a71b-a3d7f620d458 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:02:05.217988 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 570/1144] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:02:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:02:09.412009 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474d481-a0b6-485f-998a-36c125eca512 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:09.412592 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474d481-a0b6-485f-998a-36c125eca512 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:09.412592 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474d481-a0b6-485f-998a-36c125eca512 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:09.413928 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 575/1145] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:02:09.419609 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715c82-e907-4cc9-b3a8-037c3caaf73f None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:09.420023 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715c82-e907-4cc9-b3a8-037c3caaf73f None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:09.420145 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715c82-e907-4cc9-b3a8-037c3caaf73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:09.439402 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-ef715c82-e907-4cc9-b3a8-037c3caaf73f None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:02:09.440613 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-ef715c82-e907-4cc9-b3a8-037c3caaf73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:02:09.448407 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 571/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:02:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:02:09.491569 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474d481-a0b6-485f-998a-36c125eca512 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:02:09.493615 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-b474d481-a0b6-485f-998a-36c125eca512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:02:09.550840 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474d481-a0b6-485f-998a-36c125eca512 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:02:09.554263 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623505bc-83dc-48dd-9548-c5d3c2776f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:02:09.554923 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623505bc-83dc-48dd-9548-c5d3c2776f3d service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:09.555207 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623505bc-83dc-48dd-9548-c5d3c2776f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:09.556322 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623505bc-83dc-48dd-9548-c5d3c2776f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:09.565228 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623505bc-83dc-48dd-9548-c5d3c2776f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:02:09.566687 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623505bc-83dc-48dd-9548-c5d3c2776f3d service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:02:09.577043 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 576/1147] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:02:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:02:11.830031 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba562c-ba9b-4f39-852e-2d6abac1582c None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:11.830500 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba562c-ba9b-4f39-852e-2d6abac1582c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:11.830712 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba562c-ba9b-4f39-852e-2d6abac1582c None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:11.831979 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 572/1148] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:02:11.837312 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a29d1-076c-4eae-afed-74997f0d19d1 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:11.837727 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a29d1-076c-4eae-afed-74997f0d19d1 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:11.837871 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a29d1-076c-4eae-afed-74997f0d19d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:11.857306 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-ca1a29d1-076c-4eae-afed-74997f0d19d1 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:02:11.858550 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-ca1a29d1-076c-4eae-afed-74997f0d19d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:02:11.866174 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 577/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:02:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:02:11.903776 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba562c-ba9b-4f39-852e-2d6abac1582c None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:02:11.915093 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba562c-ba9b-4f39-852e-2d6abac1582c None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:02:11.918883 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca3b39-7715-4631-8b53-a89091902561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:02:11.919496 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca3b39-7715-4631-8b53-a89091902561 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:11.919780 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca3b39-7715-4631-8b53-a89091902561 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:11.920058 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca3b39-7715-4631-8b53-a89091902561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:11.928812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca3b39-7715-4631-8b53-a89091902561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:02:11.930229 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca3b39-7715-4631-8b53-a89091902561 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:02:11.941186 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 573/1150] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:02:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:02:15.689149 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880e07-e2e0-4959-8859-8d88479362ad None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:15.689688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880e07-e2e0-4959-8859-8d88479362ad None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:15.689688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880e07-e2e0-4959-8859-8d88479362ad None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:15.691060 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 578/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:02:15.696750 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38ad6f-dfd2-447d-97c3-dceee6e2ee46 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:15.697299 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38ad6f-dfd2-447d-97c3-dceee6e2ee46 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:15.697406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38ad6f-dfd2-447d-97c3-dceee6e2ee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:15.716487 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-1f38ad6f-dfd2-447d-97c3-dceee6e2ee46 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:02:15.717672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-1f38ad6f-dfd2-447d-97c3-dceee6e2ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:02:15.725323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 574/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:02:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:02:15.997876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880e07-e2e0-4959-8859-8d88479362ad None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:02:15.999575 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-22880e07-e2e0-4959-8859-8d88479362ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:02:16.057207 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880e07-e2e0-4959-8859-8d88479362ad None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:02:16.060745 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3fe55-6957-4bab-ab46-9dda45c5b01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856e3f650ab34f15828f1adb320d03ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:02:16.061355 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3fe55-6957-4bab-ab46-9dda45c5b01a service cinder] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:16.061641 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3fe55-6957-4bab-ab46-9dda45c5b01a service cinder] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:16.061917 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3fe55-6957-4bab-ab46-9dda45c5b01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:16.070734 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3fe55-6957-4bab-ab46-9dda45c5b01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:02:16.072742 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3fe55-6957-4bab-ab46-9dda45c5b01a service cinder] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:02:16.081958 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 579/1153] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:02:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:02:18.336040 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c7a70-0e74-4dc2-8676-0286ac098ea1 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:18.337110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c7a70-0e74-4dc2-8676-0286ac098ea1 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:18.337222 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c7a70-0e74-4dc2-8676-0286ac098ea1 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:18.339015 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 575/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:02:18.344235 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb773cf9-3695-4a22-955e-faa5a6cbc22b None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:18.344665 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb773cf9-3695-4a22-955e-faa5a6cbc22b None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:18.344795 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb773cf9-3695-4a22-955e-faa5a6cbc22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:18.365505 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-cb773cf9-3695-4a22-955e-faa5a6cbc22b None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:02:18.366741 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-cb773cf9-3695-4a22-955e-faa5a6cbc22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:02:18.374582 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 580/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:02:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:02:18.647116 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c7a70-0e74-4dc2-8676-0286ac098ea1 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:02:18.648799 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-3b1c7a70-0e74-4dc2-8676-0286ac098ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:02:18.661966 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c7a70-0e74-4dc2-8676-0286ac098ea1 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:02:18.665455 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4d5b3-5771-4f99-8b21-ad2eccb4b5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856e3f650ab34f15828f1adb320d03ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:02:18.666060 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4d5b3-5771-4f99-8b21-ad2eccb4b5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:02:18.666346 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4d5b3-5771-4f99-8b21-ad2eccb4b5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:02:18.666660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4d5b3-5771-4f99-8b21-ad2eccb4b5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:02:18.675416 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4d5b3-5771-4f99-8b21-ad2eccb4b5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:02:18.676850 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4d5b3-5771-4f99-8b21-ad2eccb4b5e6 service cinder] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:02:18.686774 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 576/1156] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:02:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:02:28.360811 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=70 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:02:28.682854 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=75 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:37.667552 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0e92f-246e-455c-acb2-75fc98f400af None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.668215 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0e92f-246e-455c-acb2-75fc98f400af None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.668215 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0e92f-246e-455c-acb2-75fc98f400af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.670775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef016e-9f2f-4d98-977a-75294f8dbe1c None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.671278 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef016e-9f2f-4d98-977a-75294f8dbe1c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.671386 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef016e-9f2f-4d98-977a-75294f8dbe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.688969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-a1f0e92f-246e-455c-acb2-75fc98f400af None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:37.690886 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-c5ef016e-9f2f-4d98-977a-75294f8dbe1c None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:37.695918 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-c5ef016e-9f2f-4d98-977a-75294f8dbe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:37.696101 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-a1f0e92f-246e-455c-acb2-75fc98f400af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:37.704658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 577/1157] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:03:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:03:37.706404 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 581/1158] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:03:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:03:37.713387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bdff7-e8d8-4a9c-9f1e-cefd8db8dec7 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.713684 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bdff7-e8d8-4a9c-9f1e-cefd8db8dec7 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.714158 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bdff7-e8d8-4a9c-9f1e-cefd8db8dec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.714545 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44f71-972f-47ac-a2e1-797751850ddc None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.715011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44f71-972f-47ac-a2e1-797751850ddc None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.715255 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44f71-972f-47ac-a2e1-797751850ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.735943 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-d5e44f71-972f-47ac-a2e1-797751850ddc None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:37.737157 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-d5e44f71-972f-47ac-a2e1-797751850ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:37.737286 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-478bdff7-e8d8-4a9c-9f1e-cefd8db8dec7 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:37.738331 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-478bdff7-e8d8-4a9c-9f1e-cefd8db8dec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:37.746538 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 582/1159] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:03:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:03:37.746702 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 578/1160] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:03:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:03:37.750657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e44f71-972f-47ac-a2e1-797751850ddc None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:37.751083 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bdff7-e8d8-4a9c-9f1e-cefd8db8dec7 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:37.759675 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e44f71-972f-47ac-a2e1-797751850ddc None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:37.760131 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bdff7-e8d8-4a9c-9f1e-cefd8db8dec7 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:37.766247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e72d8-4570-463f-b148-b106795ae3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:37.766924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e72d8-4570-463f-b148-b106795ae3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.767087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e04d69-cec6-4880-bdb3-26c1748891f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:37.767212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e72d8-4570-463f-b148-b106795ae3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.767481 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e72d8-4570-463f-b148-b106795ae3a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.767714 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e04d69-cec6-4880-bdb3-26c1748891f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.767986 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e04d69-cec6-4880-bdb3-26c1748891f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.768264 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e04d69-cec6-4880-bdb3-26c1748891f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.768380 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e72d8-4570-463f-b148-b106795ae3a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:03:37.768628 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e72d8-4570-463f-b148-b106795ae3a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:37.768970 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e04d69-cec6-4880-bdb3-26c1748891f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:03:37.769278 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e04d69-cec6-4880-bdb3-26c1748891f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:37.770240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e72d8-4570-463f-b148-b106795ae3a1 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:37.770366 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: WARNING py.warnings [None req-c5e04d69-cec6-4880-bdb3-26c1748891f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:03:37.770366 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: warnings.warn(msg) Jul 27 18:03:37.770366 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: Jul 27 18:03:37.771223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e04d69-cec6-4880-bdb3-26c1748891f3 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:37.783560 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 583/1161] 10.222.0.73 () {58 vars in 1153 bytes} [Wed Jul 27 18:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:03:37.784731 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 579/1162] 10.222.0.73 () {58 vars in 1153 bytes} [Wed Jul 27 18:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:03:37.791810 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e72d8-4570-463f-b148-b106795ae3a1 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:37.792562 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e04d69-cec6-4880-bdb3-26c1748891f3 admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:37.801954 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e72d8-4570-463f-b148-b106795ae3a1 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:37.802287 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e04d69-cec6-4880-bdb3-26c1748891f3 admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:37.806554 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77e92d-e89d-44b6-8190-3320cae35e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:37.806776 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7e06-e035-43ef-88f1-f7aa7db11a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:37.807759 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77e92d-e89d-44b6-8190-3320cae35e60 admin admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.808047 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77e92d-e89d-44b6-8190-3320cae35e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.808182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7e06-e035-43ef-88f1-f7aa7db11a44 admin admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.808359 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77e92d-e89d-44b6-8190-3320cae35e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.808614 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7e06-e035-43ef-88f1-f7aa7db11a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.809031 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77e92d-e89d-44b6-8190-3320cae35e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:37.809140 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7e06-e035-43ef-88f1-f7aa7db11a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.809990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7e06-e035-43ef-88f1-f7aa7db11a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:37.810091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: WARNING py.warnings [None req-1f77e92d-e89d-44b6-8190-3320cae35e60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:03:37.810091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: warnings.warn(msg) Jul 27 18:03:37.810091 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: Jul 27 18:03:37.811266 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77e92d-e89d-44b6-8190-3320cae35e60 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:37.811918 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7e06-e035-43ef-88f1-f7aa7db11a44 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:37.849409 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 580/1163] 10.222.0.73 () {60 vars in 1153 bytes} [Wed Jul 27 18:03:37 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:03:37.852181 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 584/1164] 10.222.0.73 () {60 vars in 1153 bytes} [Wed Jul 27 18:03:37 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:03:37.856799 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7e06-e035-43ef-88f1-f7aa7db11a44 admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:37.856973 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77e92d-e89d-44b6-8190-3320cae35e60 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:37.918800 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7e06-e035-43ef-88f1-f7aa7db11a44 admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:37.922915 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77e92d-e89d-44b6-8190-3320cae35e60 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:37.924392 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a09c8-4300-46fa-9a52-07d2771e323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:37.925148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a09c8-4300-46fa-9a52-07d2771e323e admin admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.925448 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a09c8-4300-46fa-9a52-07d2771e323e admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.925765 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a09c8-4300-46fa-9a52-07d2771e323e admin admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.926486 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a09c8-4300-46fa-9a52-07d2771e323e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:37.927545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: WARNING py.warnings [None req-d97a09c8-4300-46fa-9a52-07d2771e323e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:03:37.927545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: warnings.warn(msg) Jul 27 18:03:37.927545 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: Jul 27 18:03:37.928773 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a09c8-4300-46fa-9a52-07d2771e323e admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:37.929480 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd12b55-3747-4c8e-91ca-7682404b418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:37.930313 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12b55-3747-4c8e-91ca-7682404b418e admin admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.930637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12b55-3747-4c8e-91ca-7682404b418e admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.930921 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12b55-3747-4c8e-91ca-7682404b418e admin admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.931595 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd12b55-3747-4c8e-91ca-7682404b418e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:37.933608 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd12b55-3747-4c8e-91ca-7682404b418e admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:37.950851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 581/1165] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 18:03:37 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:03:37.954959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a09c8-4300-46fa-9a52-07d2771e323e admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:37.958875 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 585/1166] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 18:03:37 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:03:37.959819 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd12b55-3747-4c8e-91ca-7682404b418e admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:37.965406 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a09c8-4300-46fa-9a52-07d2771e323e admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:37.970093 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd12b55-3747-4c8e-91ca-7682404b418e admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:37.970753 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25248610-da9e-4401-b4af-92225e4beb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:37.971372 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248610-da9e-4401-b4af-92225e4beb1c admin admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.971655 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248610-da9e-4401-b4af-92225e4beb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.971935 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248610-da9e-4401-b4af-92225e4beb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.972658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25248610-da9e-4401-b4af-92225e4beb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:37.974287 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25248610-da9e-4401-b4af-92225e4beb1c admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:37.974758 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef270a-6e8b-4c58-ba48-012ab14f49d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:37.975390 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef270a-6e8b-4c58-ba48-012ab14f49d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:37.975763 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef270a-6e8b-4c58-ba48-012ab14f49d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:37.976041 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef270a-6e8b-4c58-ba48-012ab14f49d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:37.976730 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef270a-6e8b-4c58-ba48-012ab14f49d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:37.978303 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef270a-6e8b-4c58-ba48-012ab14f49d5 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:37.985529 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 582/1167] 10.222.0.73 () {58 vars in 1122 bytes} [Wed Jul 27 18:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:03:37.991653 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 586/1168] 10.222.0.73 () {58 vars in 1122 bytes} [Wed Jul 27 18:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:03:37.991808 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25248610-da9e-4401-b4af-92225e4beb1c admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:37.992561 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef270a-6e8b-4c58-ba48-012ab14f49d5 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:38.000115 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25248610-da9e-4401-b4af-92225e4beb1c admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:38.001986 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef270a-6e8b-4c58-ba48-012ab14f49d5 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:38.004951 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e2c42-1c0c-4d01-b933-4cfa4daf1b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:38.005558 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e2c42-1c0c-4d01-b933-4cfa4daf1b97 admin admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:38.005842 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e2c42-1c0c-4d01-b933-4cfa4daf1b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:38.006121 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e2c42-1c0c-4d01-b933-4cfa4daf1b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:38.006689 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af8b97-96e9-444b-af52-21dd4f517141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:38.006824 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e2c42-1c0c-4d01-b933-4cfa4daf1b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:38.007278 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af8b97-96e9-444b-af52-21dd4f517141 admin admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:38.007563 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af8b97-96e9-444b-af52-21dd4f517141 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:38.007850 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af8b97-96e9-444b-af52-21dd4f517141 admin admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:38.008440 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e2c42-1c0c-4d01-b933-4cfa4daf1b97 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:38.008546 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af8b97-96e9-444b-af52-21dd4f517141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:38.010485 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af8b97-96e9-444b-af52-21dd4f517141 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:38.023555 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 583/1169] 10.222.0.73 () {58 vars in 1122 bytes} [Wed Jul 27 18:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:03:38.023747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 587/1170] 10.222.0.73 () {58 vars in 1122 bytes} [Wed Jul 27 18:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:03:38.024663 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af8b97-96e9-444b-af52-21dd4f517141 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:38.024781 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e2c42-1c0c-4d01-b933-4cfa4daf1b97 admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:38.035550 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e2c42-1c0c-4d01-b933-4cfa4daf1b97 admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:38.035711 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af8b97-96e9-444b-af52-21dd4f517141 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:38.040252 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024196f-e2a2-4fbb-bbc5-48a6f8d2201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:38.040391 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba160594-668e-4228-86d9-a3cc1b98934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:38.040904 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024196f-e2a2-4fbb-bbc5-48a6f8d2201b admin admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:38.041026 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba160594-668e-4228-86d9-a3cc1b98934b admin admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:38.041242 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024196f-e2a2-4fbb-bbc5-48a6f8d2201b admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:38.041887 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba160594-668e-4228-86d9-a3cc1b98934b admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:38.042249 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba160594-668e-4228-86d9-a3cc1b98934b admin admin] PATH_INFO: `/v3/projects/0306beae7ba74e629b9b8f9dde062a30/users/a8a906fcdba344d59bdbfa0ac9f5a4e2/roles/a2eb0e476c1f497888d73bb1d1771d16` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:38.042389 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024196f-e2a2-4fbb-bbc5-48a6f8d2201b admin admin] PATH_INFO: `/v3/projects/5d2bc566a1c9440f81b52c0f7ad8840e/users/b17b75a81fdc48e99ea19a1c65007e53/roles/a2eb0e476c1f497888d73bb1d1771d16` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:38.056571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024196f-e2a2-4fbb-bbc5-48a6f8d2201b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d2bc566a1c9440f81b52c0f7ad8840e, user_id=b17b75a81fdc48e99ea19a1c65007e53, role_id=a2eb0e476c1f497888d73bb1d1771d16)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:38.056861 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba160594-668e-4228-86d9-a3cc1b98934b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0306beae7ba74e629b9b8f9dde062a30, user_id=a8a906fcdba344d59bdbfa0ac9f5a4e2, role_id=a2eb0e476c1f497888d73bb1d1771d16)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:38.057772 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: WARNING py.warnings [None req-5024196f-e2a2-4fbb-bbc5-48a6f8d2201b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:03:38.057772 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: warnings.warn(msg) Jul 27 18:03:38.057772 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: Jul 27 18:03:38.059714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024196f-e2a2-4fbb-bbc5-48a6f8d2201b admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:38.059816 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba160594-668e-4228-86d9-a3cc1b98934b admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:38.072456 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 588/1171] 10.222.0.73 () {60 vars in 1483 bytes} [Wed Jul 27 18:03:38 2022] PUT /identity/v3/projects/5d2bc566a1c9440f81b52c0f7ad8840e/users/b17b75a81fdc48e99ea19a1c65007e53/roles/a2eb0e476c1f497888d73bb1d1771d16 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:03:38.073981 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 584/1172] 10.222.0.73 () {60 vars in 1483 bytes} [Wed Jul 27 18:03:38 2022] PUT /identity/v3/projects/0306beae7ba74e629b9b8f9dde062a30/users/a8a906fcdba344d59bdbfa0ac9f5a4e2/roles/a2eb0e476c1f497888d73bb1d1771d16 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:03:38.077742 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8965c6b-953b-420b-adf6-641669d4f49d None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:38.078028 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8965c6b-953b-420b-adf6-641669d4f49d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:38.078302 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8965c6b-953b-420b-adf6-641669d4f49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:38.078664 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf87c0-793d-458c-9c23-54747cc49e37 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:38.078990 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf87c0-793d-458c-9c23-54747cc49e37 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:38.079281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf87c0-793d-458c-9c23-54747cc49e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:38.097135 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-d8965c6b-953b-420b-adf6-641669d4f49d None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:38.098338 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-d8965c6b-953b-420b-adf6-641669d4f49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:38.098722 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-78bf87c0-793d-458c-9c23-54747cc49e37 None None] MFA Rules not processed for user `1c437a71edd54d15a20aca35e290b469`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:38.099921 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-78bf87c0-793d-458c-9c23-54747cc49e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:38.140836 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:38.142064 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:38.161341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 589/1173] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:03:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:03:38.164608 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 585/1174] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:03:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:03:38.171576 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8965c6b-953b-420b-adf6-641669d4f49d None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:38.172524 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf87c0-793d-458c-9c23-54747cc49e37 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:38.173896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-78bf87c0-793d-458c-9c23-54747cc49e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:38.227025 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8965c6b-953b-420b-adf6-641669d4f49d None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:38.231448 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bb4d6-3a84-4608-9983-b68f60e99857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:38.232074 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bb4d6-3a84-4608-9983-b68f60e99857 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:38.232360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bb4d6-3a84-4608-9983-b68f60e99857 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:38.232648 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bb4d6-3a84-4608-9983-b68f60e99857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:38.241570 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bb4d6-3a84-4608-9983-b68f60e99857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:38.242424 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf87c0-793d-458c-9c23-54747cc49e37 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:38.243039 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bb4d6-3a84-4608-9983-b68f60e99857 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:38.246439 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e36bd-ef63-43b0-a611-eb32b2717125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:38.247091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e36bd-ef63-43b0-a611-eb32b2717125 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:38.247369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e36bd-ef63-43b0-a611-eb32b2717125 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:38.247643 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e36bd-ef63-43b0-a611-eb32b2717125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:38.252466 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 590/1175] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:03:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:03:38.256630 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e36bd-ef63-43b0-a611-eb32b2717125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:38.258067 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e36bd-ef63-43b0-a611-eb32b2717125 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:38.268462 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 586/1176] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:03:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:03:43.212118 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c4e84-be78-4292-926c-0480a2ef7c78 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:43.212720 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c4e84-be78-4292-926c-0480a2ef7c78 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:43.216975 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c4e84-be78-4292-926c-0480a2ef7c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:43.294159 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-027c4e84-be78-4292-926c-0480a2ef7c78 None None] MFA Rules not processed for user `b17b75a81fdc48e99ea19a1c65007e53`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:43.295338 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-027c4e84-be78-4292-926c-0480a2ef7c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:43.430898 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 591/1177] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:03:43 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:03:43.431804 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e36bd-ef63-43b0-a611-eb32b2717125 service neutron] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:43.464519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e36bd-ef63-43b0-a611-eb32b2717125 service neutron] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:43.470539 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b099f7-b7bf-4b35-8318-333b8c0d9968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:43.471365 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b099f7-b7bf-4b35-8318-333b8c0d9968 admin admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:43.471873 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b099f7-b7bf-4b35-8318-333b8c0d9968 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:43.472228 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b099f7-b7bf-4b35-8318-333b8c0d9968 admin admin] PATH_INFO: `/v3/projects` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:43.473139 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b099f7-b7bf-4b35-8318-333b8c0d9968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:43.475312 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b099f7-b7bf-4b35-8318-333b8c0d9968 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:43.552468 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 587/1178] 10.222.0.73 () {60 vars in 1153 bytes} [Wed Jul 27 18:03:43 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:03:43.556662 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c4e84-be78-4292-926c-0480a2ef7c78 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:43.575704 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c4e84-be78-4292-926c-0480a2ef7c78 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:43.715526 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45526b-e877-448f-94ac-dc18894d5c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:43.716275 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45526b-e877-448f-94ac-dc18894d5c0e admin admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:43.716894 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45526b-e877-448f-94ac-dc18894d5c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:43.717273 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45526b-e877-448f-94ac-dc18894d5c0e admin admin] PATH_INFO: `/v3/users` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:43.718080 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45526b-e877-448f-94ac-dc18894d5c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:43.720393 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45526b-e877-448f-94ac-dc18894d5c0e admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:43.759634 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b099f7-b7bf-4b35-8318-333b8c0d9968 admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:43.764471 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 592/1179] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 18:03:43 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:03:43.773699 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b099f7-b7bf-4b35-8318-333b8c0d9968 admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:43.779755 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a9af0-70be-42bc-b6ec-ae23dec961e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:43.780554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a9af0-70be-42bc-b6ec-ae23dec961e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:43.780954 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a9af0-70be-42bc-b6ec-ae23dec961e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:43.781309 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a9af0-70be-42bc-b6ec-ae23dec961e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:43.782292 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a9af0-70be-42bc-b6ec-ae23dec961e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:43.785094 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a9af0-70be-42bc-b6ec-ae23dec961e0 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:43.807624 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45526b-e877-448f-94ac-dc18894d5c0e admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:43.810553 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 588/1180] 10.222.0.73 () {58 vars in 1122 bytes} [Wed Jul 27 18:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:03:43.818527 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45526b-e877-448f-94ac-dc18894d5c0e admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:43.825260 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf4be3-b984-4a54-8f96-3c58d5ae38f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:43.826314 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4be3-b984-4a54-8f96-3c58d5ae38f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:43.827410 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4be3-b984-4a54-8f96-3c58d5ae38f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:43.831064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4be3-b984-4a54-8f96-3c58d5ae38f3 admin admin] PATH_INFO: `/v3/projects/c54340e9ad4b4267b250ca6b5f6b590b/users/ec3147f25972479b973bc666b9b6b975/roles/d6d0c56d1054455c813546a2c761a7d0` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:43.839196 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:43.854687 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf4be3-b984-4a54-8f96-3c58d5ae38f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54340e9ad4b4267b250ca6b5f6b590b, user_id=ec3147f25972479b973bc666b9b6b975, role_id=d6d0c56d1054455c813546a2c761a7d0)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:43.857612 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf4be3-b984-4a54-8f96-3c58d5ae38f3 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:43.890698 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 593/1181] 10.222.0.73 () {60 vars in 1483 bytes} [Wed Jul 27 18:03:43 2022] PUT /identity/v3/projects/c54340e9ad4b4267b250ca6b5f6b590b/users/ec3147f25972479b973bc666b9b6b975/roles/d6d0c56d1054455c813546a2c761a7d0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:03:43.893021 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a9af0-70be-42bc-b6ec-ae23dec961e0 admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:43.906702 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a9af0-70be-42bc-b6ec-ae23dec961e0 admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:43.993638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8186b-ae18-415d-990d-8d99f81a7778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:43.995110 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8186b-ae18-415d-990d-8d99f81a7778 admin admin] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:43.995980 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8186b-ae18-415d-990d-8d99f81a7778 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:43.996185 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8186b-ae18-415d-990d-8d99f81a7778 admin admin] PATH_INFO: `/v3/roles` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:43.996986 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8186b-ae18-415d-990d-8d99f81a7778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:43.999051 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8186b-ae18-415d-990d-8d99f81a7778 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:44.017634 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 589/1182] 10.222.0.73 () {58 vars in 1122 bytes} [Wed Jul 27 18:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:03:44.021503 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf4be3-b984-4a54-8f96-3c58d5ae38f3 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:44.037247 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf4be3-b984-4a54-8f96-3c58d5ae38f3 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:44.043931 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b756902-d62b-4239-8fae-781c7f16b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:44.044746 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b756902-d62b-4239-8fae-781c7f16b6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:44.045133 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b756902-d62b-4239-8fae-781c7f16b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:44.045744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b756902-d62b-4239-8fae-781c7f16b6e5 admin admin] PATH_INFO: `/v3/projects/c54340e9ad4b4267b250ca6b5f6b590b/users/ec3147f25972479b973bc666b9b6b975/roles/d6d0c56d1054455c813546a2c761a7d0` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:44.051683 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b756902-d62b-4239-8fae-781c7f16b6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54340e9ad4b4267b250ca6b5f6b590b, user_id=ec3147f25972479b973bc666b9b6b975, role_id=d6d0c56d1054455c813546a2c761a7d0)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:44.055357 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b756902-d62b-4239-8fae-781c7f16b6e5 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:44.069293 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 594/1183] 10.222.0.73 () {60 vars in 1483 bytes} [Wed Jul 27 18:03:44 2022] PUT /identity/v3/projects/c54340e9ad4b4267b250ca6b5f6b590b/users/ec3147f25972479b973bc666b9b6b975/roles/d6d0c56d1054455c813546a2c761a7d0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:03:44.185265 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f879b-5bd5-49f6-af00-43c56bf333de None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:44.185684 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f879b-5bd5-49f6-af00-43c56bf333de None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:44.186065 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f879b-5bd5-49f6-af00-43c56bf333de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:44.221260 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-9a9f879b-5bd5-49f6-af00-43c56bf333de None None] MFA Rules not processed for user `a8a906fcdba344d59bdbfa0ac9f5a4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:44.222943 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-9a9f879b-5bd5-49f6-af00-43c56bf333de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:44.264597 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:44.314558 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 590/1184] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:03:44 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:03:44.317328 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b756902-d62b-4239-8fae-781c7f16b6e5 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:44.404497 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b756902-d62b-4239-8fae-781c7f16b6e5 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:44.410772 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b92b9-de2f-4ad8-a776-69515013e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:44.412119 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b92b9-de2f-4ad8-a776-69515013e136 admin admin] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:44.412411 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b92b9-de2f-4ad8-a776-69515013e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:44.412688 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b92b9-de2f-4ad8-a776-69515013e136 admin admin] PATH_INFO: `/v3/projects` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:44.413678 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b92b9-de2f-4ad8-a776-69515013e136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:44.415657 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b92b9-de2f-4ad8-a776-69515013e136 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:44.474995 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 595/1185] 10.222.0.73 () {60 vars in 1153 bytes} [Wed Jul 27 18:03:44 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:03:44.479293 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f879b-5bd5-49f6-af00-43c56bf333de None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:44.498020 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f879b-5bd5-49f6-af00-43c56bf333de None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:44.585968 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36fe7f-5a61-40cd-8fc2-e438a2164f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:44.586634 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36fe7f-5a61-40cd-8fc2-e438a2164f89 admin admin] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:44.589784 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36fe7f-5a61-40cd-8fc2-e438a2164f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:44.590627 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36fe7f-5a61-40cd-8fc2-e438a2164f89 admin admin] PATH_INFO: `/v3/users` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:44.591599 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36fe7f-5a61-40cd-8fc2-e438a2164f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:44.593826 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36fe7f-5a61-40cd-8fc2-e438a2164f89 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:44.632384 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 591/1186] 10.222.0.73 () {60 vars in 1144 bytes} [Wed Jul 27 18:03:44 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:03:44.637847 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b92b9-de2f-4ad8-a776-69515013e136 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:44.667341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b92b9-de2f-4ad8-a776-69515013e136 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:44.706713 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3748a29-0c1e-4337-8cc4-2743912c5d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:44.708486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748a29-0c1e-4337-8cc4-2743912c5d74 admin admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:44.708979 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748a29-0c1e-4337-8cc4-2743912c5d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:44.709477 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748a29-0c1e-4337-8cc4-2743912c5d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:44.710320 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3748a29-0c1e-4337-8cc4-2743912c5d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:44.712259 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3748a29-0c1e-4337-8cc4-2743912c5d74 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:44.725857 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 596/1187] 10.222.0.73 () {58 vars in 1122 bytes} [Wed Jul 27 18:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:03:44.730797 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36fe7f-5a61-40cd-8fc2-e438a2164f89 admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:44.745901 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36fe7f-5a61-40cd-8fc2-e438a2164f89 admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:44.754276 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ad2e7-afba-4226-ba19-2ab20df2b7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:44.755091 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ad2e7-afba-4226-ba19-2ab20df2b7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:44.755519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ad2e7-afba-4226-ba19-2ab20df2b7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:44.755908 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ad2e7-afba-4226-ba19-2ab20df2b7ca admin admin] PATH_INFO: `/v3/projects/ef1d8e4561f2430cb4cdb1bdf53070ff/users/8a0e75df2d694e70ba143dccd4fa0cbf/roles/d6d0c56d1054455c813546a2c761a7d0` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:44.781897 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ad2e7-afba-4226-ba19-2ab20df2b7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1d8e4561f2430cb4cdb1bdf53070ff, user_id=8a0e75df2d694e70ba143dccd4fa0cbf, role_id=d6d0c56d1054455c813546a2c761a7d0)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:44.785277 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ad2e7-afba-4226-ba19-2ab20df2b7ca admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:44.810309 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 592/1188] 10.222.0.73 () {60 vars in 1483 bytes} [Wed Jul 27 18:03:44 2022] PUT /identity/v3/projects/ef1d8e4561f2430cb4cdb1bdf53070ff/users/8a0e75df2d694e70ba143dccd4fa0cbf/roles/d6d0c56d1054455c813546a2c761a7d0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:03:44.814378 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3748a29-0c1e-4337-8cc4-2743912c5d74 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:44.826751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3748a29-0c1e-4337-8cc4-2743912c5d74 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:44.950894 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78025c3e-c180-4673-b6ce-0c435ed0ea85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:44.951893 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025c3e-c180-4673-b6ce-0c435ed0ea85 admin admin] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:44.952326 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025c3e-c180-4673-b6ce-0c435ed0ea85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:44.952811 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025c3e-c180-4673-b6ce-0c435ed0ea85 admin admin] PATH_INFO: `/v3/roles` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:44.954237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78025c3e-c180-4673-b6ce-0c435ed0ea85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:44.956494 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78025c3e-c180-4673-b6ce-0c435ed0ea85 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:44.991237 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 597/1189] 10.222.0.73 () {58 vars in 1122 bytes} [Wed Jul 27 18:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:03:44.995626 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ad2e7-afba-4226-ba19-2ab20df2b7ca admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:45.009331 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ad2e7-afba-4226-ba19-2ab20df2b7ca admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:45.019347 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567fa55-bef8-45a5-8306-ffad35f9eeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:45.020214 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567fa55-bef8-45a5-8306-ffad35f9eeee admin admin] REQUEST_METHOD: `PUT` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:45.020504 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567fa55-bef8-45a5-8306-ffad35f9eeee admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:45.022105 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567fa55-bef8-45a5-8306-ffad35f9eeee admin admin] PATH_INFO: `/v3/projects/ef1d8e4561f2430cb4cdb1bdf53070ff/users/8a0e75df2d694e70ba143dccd4fa0cbf/roles/d6d0c56d1054455c813546a2c761a7d0` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:45.024509 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567fa55-bef8-45a5-8306-ffad35f9eeee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1d8e4561f2430cb4cdb1bdf53070ff, user_id=8a0e75df2d694e70ba143dccd4fa0cbf, role_id=d6d0c56d1054455c813546a2c761a7d0)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:45.028720 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567fa55-bef8-45a5-8306-ffad35f9eeee admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:45.044008 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 593/1190] 10.222.0.73 () {60 vars in 1483 bytes} [Wed Jul 27 18:03:44 2022] PUT /identity/v3/projects/ef1d8e4561f2430cb4cdb1bdf53070ff/users/8a0e75df2d694e70ba143dccd4fa0cbf/roles/d6d0c56d1054455c813546a2c761a7d0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:03:51.188362 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cccd9-d393-40ed-8b60-a35c15d64b40 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:51.189841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cccd9-d393-40ed-8b60-a35c15d64b40 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:51.190349 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cccd9-d393-40ed-8b60-a35c15d64b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:51.227585 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-b56cccd9-d393-40ed-8b60-a35c15d64b40 None None] MFA Rules not processed for user `ec3147f25972479b973bc666b9b6b975`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:51.229830 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-b56cccd9-d393-40ed-8b60-a35c15d64b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:51.269635 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:51.321651 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 598/1191] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:03:51 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:03:51.339586 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567fa55-bef8-45a5-8306-ffad35f9eeee admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:51.341883 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-5567fa55-bef8-45a5-8306-ffad35f9eeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:51.481116 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567fa55-bef8-45a5-8306-ffad35f9eeee admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:51.492741 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5a792-3c5a-4ff5-923b-b14aa814c9c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0601985b76490dae3f9d0ce2fe9505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:51.493669 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a792-3c5a-4ff5-923b-b14aa814c9c3 service glance] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:51.493812 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a792-3c5a-4ff5-923b-b14aa814c9c3 service glance] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:51.494087 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a792-3c5a-4ff5-923b-b14aa814c9c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:51.541182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:51.584472 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5a792-3c5a-4ff5-923b-b14aa814c9c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:51.586147 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5a792-3c5a-4ff5-923b-b14aa814c9c3 service glance] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:51.597636 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 594/1192] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:03:51 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:03:51.843931 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ee97e-9fb3-4b8e-b5bc-90aeb1e36b51 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:51.844445 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ee97e-9fb3-4b8e-b5bc-90aeb1e36b51 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:51.845336 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ee97e-9fb3-4b8e-b5bc-90aeb1e36b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:51.888551 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-b92ee97e-9fb3-4b8e-b5bc-90aeb1e36b51 None None] MFA Rules not processed for user `8a0e75df2d694e70ba143dccd4fa0cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:51.891966 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-b92ee97e-9fb3-4b8e-b5bc-90aeb1e36b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:52.046627 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 599/1193] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:03:51 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:03:52.053366 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5a792-3c5a-4ff5-923b-b14aa814c9c3 service glance] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:52.069414 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5a792-3c5a-4ff5-923b-b14aa814c9c3 service glance] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:52.080071 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9756948-234c-4995-b5f2-3b44a4559f60 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0601985b76490dae3f9d0ce2fe9505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:52.080719 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9756948-234c-4995-b5f2-3b44a4559f60 service glance] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:52.080998 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9756948-234c-4995-b5f2-3b44a4559f60 service glance] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:52.081270 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9756948-234c-4995-b5f2-3b44a4559f60 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:52.204587 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9756948-234c-4995-b5f2-3b44a4559f60 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:52.206278 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9756948-234c-4995-b5f2-3b44a4559f60 service glance] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:52.218587 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 595/1194] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:03:52 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:04:00.968436 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52b49-aedf-4072-835c-304b83d94f6f None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:00.969026 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52b49-aedf-4072-835c-304b83d94f6f None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:00.969026 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52b49-aedf-4072-835c-304b83d94f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:00.991217 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-aac52b49-aedf-4072-835c-304b83d94f6f None None] MFA Rules not processed for user `a8a906fcdba344d59bdbfa0ac9f5a4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:00.992433 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-aac52b49-aedf-4072-835c-304b83d94f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:00.999747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 600/1195] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:04:00 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:01.300681 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64f46-baa9-4592-8f57-776848adc26c None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:01.301211 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64f46-baa9-4592-8f57-776848adc26c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:01.301426 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64f46-baa9-4592-8f57-776848adc26c None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:01.303576 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 596/1196] 10.222.0.73 () {54 vars in 962 bytes} [Wed Jul 27 18:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:01.308886 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25636fd-a220-4f71-b12f-11217f40c694 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:01.309182 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25636fd-a220-4f71-b12f-11217f40c694 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:01.309464 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25636fd-a220-4f71-b12f-11217f40c694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:01.343425 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-c25636fd-a220-4f71-b12f-11217f40c694 None None] MFA Rules not processed for user `de6300c387da4594bca473cd708b79f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:01.344850 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-c25636fd-a220-4f71-b12f-11217f40c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:01.423667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 601/1197] 10.222.0.73 () {58 vars in 1059 bytes} [Wed Jul 27 18:04:01 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:01.428987 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0c83-aaf4-4aff-8b11-c82a322b24b3 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:01.429279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0c83-aaf4-4aff-8b11-c82a322b24b3 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:01.429559 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0c83-aaf4-4aff-8b11-c82a322b24b3 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:01.430940 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 597/1198] 10.222.0.73 () {54 vars in 912 bytes} [Wed Jul 27 18:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:01.436005 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fda3a-9b63-4219-92ed-74cd323eea81 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:01.436343 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fda3a-9b63-4219-92ed-74cd323eea81 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:01.436686 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fda3a-9b63-4219-92ed-74cd323eea81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:01.462068 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-0f2fda3a-9b63-4219-92ed-74cd323eea81 None None] MFA Rules not processed for user `de6300c387da4594bca473cd708b79f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:01.463520 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-0f2fda3a-9b63-4219-92ed-74cd323eea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:01.472900 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 602/1199] 10.222.0.73 () {58 vars in 1009 bytes} [Wed Jul 27 18:04:01 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:01.485282 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e0c83-aaf4-4aff-8b11-c82a322b24b3 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:01.487003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-c18e0c83-aaf4-4aff-8b11-c82a322b24b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:01.500859 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e0c83-aaf4-4aff-8b11-c82a322b24b3 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:01.504397 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310da1f-7fd7-4eac-a6b0-1aaf924e1133 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0601985b76490dae3f9d0ce2fe9505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:01.505003 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310da1f-7fd7-4eac-a6b0-1aaf924e1133 service glance] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:01.505287 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310da1f-7fd7-4eac-a6b0-1aaf924e1133 service glance] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:01.505562 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310da1f-7fd7-4eac-a6b0-1aaf924e1133 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:01.515595 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310da1f-7fd7-4eac-a6b0-1aaf924e1133 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:01.517135 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310da1f-7fd7-4eac-a6b0-1aaf924e1133 service glance] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:01.529584 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 598/1200] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:04:01 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:04:01.895847 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d675f-db6a-4b44-9c24-373e73f2f0d7 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:01.896145 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d675f-db6a-4b44-9c24-373e73f2f0d7 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:01.896430 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d675f-db6a-4b44-9c24-373e73f2f0d7 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:01.897814 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 603/1201] 10.222.0.73 () {54 vars in 912 bytes} [Wed Jul 27 18:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:01.905267 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8bb6b-088a-4a9b-9533-7c40f084d8d1 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:01.905772 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8bb6b-088a-4a9b-9533-7c40f084d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:01.906202 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8bb6b-088a-4a9b-9533-7c40f084d8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:01.929382 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-53b8bb6b-088a-4a9b-9533-7c40f084d8d1 None None] MFA Rules not processed for user `54abb42639f1401bb6433e2d4642d741`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:01.930826 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-53b8bb6b-088a-4a9b-9533-7c40f084d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:01.985213 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 599/1202] 10.222.0.73 () {58 vars in 1009 bytes} [Wed Jul 27 18:04:01 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:02.001026 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d675f-db6a-4b44-9c24-373e73f2f0d7 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:02.014232 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d675f-db6a-4b44-9c24-373e73f2f0d7 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:02.017919 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570694d1-1f5a-478b-889d-0edfba0986d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:02.018586 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570694d1-1f5a-478b-889d-0edfba0986d3 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:02.018873 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570694d1-1f5a-478b-889d-0edfba0986d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:02.019156 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570694d1-1f5a-478b-889d-0edfba0986d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:02.039631 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570694d1-1f5a-478b-889d-0edfba0986d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:02.041315 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570694d1-1f5a-478b-889d-0edfba0986d3 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:02.054681 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 604/1203] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:04:01 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:04:02.487016 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9570660-8d55-4b6e-a829-a084fde9ab75 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:02.487016 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9570660-8d55-4b6e-a829-a084fde9ab75 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:02.487016 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9570660-8d55-4b6e-a829-a084fde9ab75 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:02.487016 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 600/1204] 10.222.0.73 () {54 vars in 962 bytes} [Wed Jul 27 18:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:02.491852 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7147e-55fe-4bce-9930-c2327df97525 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:02.492265 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7147e-55fe-4bce-9930-c2327df97525 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:02.492637 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7147e-55fe-4bce-9930-c2327df97525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:02.506307 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39b62-4159-47e8-a3ba-8cafc8a9fa7a None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:02.506673 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39b62-4159-47e8-a3ba-8cafc8a9fa7a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:02.507030 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39b62-4159-47e8-a3ba-8cafc8a9fa7a None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:02.508750 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 601/1205] 10.222.0.73 () {54 vars in 961 bytes} [Wed Jul 27 18:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:02.515657 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c5636-d8f5-41d7-a6aa-f0fc630edbf7 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:02.516066 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c5636-d8f5-41d7-a6aa-f0fc630edbf7 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:02.516450 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c5636-d8f5-41d7-a6aa-f0fc630edbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:02.525454 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-77c7147e-55fe-4bce-9930-c2327df97525 None None] MFA Rules not processed for user `de6300c387da4594bca473cd708b79f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:02.527666 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-77c7147e-55fe-4bce-9930-c2327df97525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:02.538291 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-3c6c5636-d8f5-41d7-a6aa-f0fc630edbf7 None None] MFA Rules not processed for user `5144a9d861f8482a8f31abc1315fe818`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:02.539149 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 605/1206] 10.222.0.73 () {58 vars in 1059 bytes} [Wed Jul 27 18:04:02 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:02.539764 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-3c6c5636-d8f5-41d7-a6aa-f0fc630edbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:02.544689 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517013dd-6530-4d75-81c3-20078763c72a None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:02.545841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517013dd-6530-4d75-81c3-20078763c72a None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:02.545841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517013dd-6530-4d75-81c3-20078763c72a None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:02.546730 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 606/1207] 10.222.0.73 () {54 vars in 912 bytes} [Wed Jul 27 18:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:02.553067 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614c295-f49f-4a31-b96e-28afa9abc334 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:02.553344 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614c295-f49f-4a31-b96e-28afa9abc334 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:02.553860 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614c295-f49f-4a31-b96e-28afa9abc334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:02.567011 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=100 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:02.583537 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-4614c295-f49f-4a31-b96e-28afa9abc334 None None] MFA Rules not processed for user `de6300c387da4594bca473cd708b79f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:02.586867 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-4614c295-f49f-4a31-b96e-28afa9abc334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:02.599972 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 607/1208] 10.222.0.73 () {58 vars in 1009 bytes} [Wed Jul 27 18:04:02 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:02.610127 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=100 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:02.612257 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614c295-f49f-4a31-b96e-28afa9abc334 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:02.628483 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614c295-f49f-4a31-b96e-28afa9abc334 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:02.634543 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df623c19-6644-40c1-86c0-d17c55139c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:02.635497 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 602/1209] 10.222.0.73 () {58 vars in 1058 bytes} [Wed Jul 27 18:04:02 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:02.636174 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623c19-6644-40c1-86c0-d17c55139c39 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:02.636387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c5636-d8f5-41d7-a6aa-f0fc630edbf7 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:02.636991 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623c19-6644-40c1-86c0-d17c55139c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:02.637802 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623c19-6644-40c1-86c0-d17c55139c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:02.650554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c5636-d8f5-41d7-a6aa-f0fc630edbf7 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:02.658486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df623c19-6644-40c1-86c0-d17c55139c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:02.660219 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df623c19-6644-40c1-86c0-d17c55139c39 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:02.665929 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82564d4-093b-458c-9148-73fbe5536657 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5144a9d861f8482a8f31abc1315fe818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:02.667362 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82564d4-093b-458c-9148-73fbe5536657 service placement] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:02.667691 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82564d4-093b-458c-9148-73fbe5536657 service placement] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:02.667959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82564d4-093b-458c-9148-73fbe5536657 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:02.670952 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-b82564d4-093b-458c-9148-73fbe5536657 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:02.684862 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 608/1210] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:04:02 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:04:02.688667 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82564d4-093b-458c-9148-73fbe5536657 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:02.690593 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82564d4-093b-458c-9148-73fbe5536657 service placement] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:02.703959 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 603/1211] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:04:02 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:04:12.674667 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=7 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:12.698559 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=7 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:12.879291 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4ed6-c603-4bdc-a8e5-ebbb75d7bf92 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:12.879672 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4ed6-c603-4bdc-a8e5-ebbb75d7bf92 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:12.879963 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4ed6-c603-4bdc-a8e5-ebbb75d7bf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:12.899713 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-4e2a4ed6-c603-4bdc-a8e5-ebbb75d7bf92 None None] MFA Rules not processed for user `54abb42639f1401bb6433e2d4642d741`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:12.901048 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-4e2a4ed6-c603-4bdc-a8e5-ebbb75d7bf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:12.907504 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 609/1212] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Jul 27 18:04:12 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:12.919501 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82564d4-093b-458c-9148-73fbe5536657 service placement] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:12.929515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82564d4-093b-458c-9148-73fbe5536657 service placement] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:12.935078 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d6db5-a76e-4eb7-9354-654d54526ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:12.935808 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d6db5-a76e-4eb7-9354-654d54526ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:12.936336 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d6db5-a76e-4eb7-9354-654d54526ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:12.937610 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d6db5-a76e-4eb7-9354-654d54526ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:12.949451 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d6db5-a76e-4eb7-9354-654d54526ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:12.951023 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d6db5-a76e-4eb7-9354-654d54526ee8 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:12.959425 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 604/1213] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:04:12 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:04:13.724673 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8afec4-f9ed-4991-8d4f-c044771360b4 None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:13.725228 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8afec4-f9ed-4991-8d4f-c044771360b4 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:13.725228 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8afec4-f9ed-4991-8d4f-c044771360b4 None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:13.727106 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 610/1214] 10.222.0.73 () {54 vars in 921 bytes} [Wed Jul 27 18:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:13.769221 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9c34f-56c9-4405-b533-ccd39d18327c None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:13.769806 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9c34f-56c9-4405-b533-ccd39d18327c None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:13.769806 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9c34f-56c9-4405-b533-ccd39d18327c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:13.799375 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-87d9c34f-56c9-4405-b533-ccd39d18327c None None] MFA Rules not processed for user `de6300c387da4594bca473cd708b79f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:13.800775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-87d9c34f-56c9-4405-b533-ccd39d18327c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:13.814332 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 605/1215] 10.222.0.73 () {58 vars in 1018 bytes} [Wed Jul 27 18:04:13 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:13.871873 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8afec4-f9ed-4991-8d4f-c044771360b4 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:13.915499 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8afec4-f9ed-4991-8d4f-c044771360b4 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:13.922615 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbebd66-af45-4ca2-a322-18d5c5031c1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:13.923599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebd66-af45-4ca2-a322-18d5c5031c1f service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:13.924064 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebd66-af45-4ca2-a322-18d5c5031c1f service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:13.924699 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebd66-af45-4ca2-a322-18d5c5031c1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:13.944868 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbebd66-af45-4ca2-a322-18d5c5031c1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:13.948447 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbebd66-af45-4ca2-a322-18d5c5031c1f service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:13.961481 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 611/1216] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:04:13 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:04:21.023650 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e4e05-ad78-4e1b-8ef1-0a835455d70a None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:21.024557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e4e05-ad78-4e1b-8ef1-0a835455d70a None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:21.024557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e4e05-ad78-4e1b-8ef1-0a835455d70a None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:21.025826 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 606/1217] 10.222.0.73 () {54 vars in 921 bytes} [Wed Jul 27 18:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:21.035279 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee9ab8-7d11-417d-9669-0b1842e48dff None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:21.035816 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee9ab8-7d11-417d-9669-0b1842e48dff None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:21.036055 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee9ab8-7d11-417d-9669-0b1842e48dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:21.062374 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-7aee9ab8-7d11-417d-9669-0b1842e48dff None None] MFA Rules not processed for user `de6300c387da4594bca473cd708b79f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:21.064341 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-7aee9ab8-7d11-417d-9669-0b1842e48dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:21.073889 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 612/1218] 10.222.0.73 () {58 vars in 1018 bytes} [Wed Jul 27 18:04:21 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:04:21.094807 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e4e05-ad78-4e1b-8ef1-0a835455d70a None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:21.117210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e4e05-ad78-4e1b-8ef1-0a835455d70a None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:21.124517 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37c94-f0b8-4523-9447-a550d7165824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:21.125372 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37c94-f0b8-4523-9447-a550d7165824 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:21.125658 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37c94-f0b8-4523-9447-a550d7165824 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:21.125938 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37c94-f0b8-4523-9447-a550d7165824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:21.135297 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a37c94-f0b8-4523-9447-a550d7165824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:21.137501 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a37c94-f0b8-4523-9447-a550d7165824 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:21.148937 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 607/1219] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:04:21 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:04:31.055599 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=12 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:31.144447 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=15 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:33.215828 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee9ab8-7d11-417d-9669-0b1842e48dff None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:33.225049 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee9ab8-7d11-417d-9669-0b1842e48dff None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:33.228760 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f17e18-0d4e-4499-99e3-325d9dc8b5fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:33.230288 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f17e18-0d4e-4499-99e3-325d9dc8b5fd service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.230705 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f17e18-0d4e-4499-99e3-325d9dc8b5fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.230985 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f17e18-0d4e-4499-99e3-325d9dc8b5fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.240290 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f17e18-0d4e-4499-99e3-325d9dc8b5fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:33.241749 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f17e18-0d4e-4499-99e3-325d9dc8b5fd service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:33.253653 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 613/1220] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:04:33 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:04:37.339790 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5519c61-5d95-42df-a5d9-27693f185d61 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:37.340417 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5519c61-5d95-42df-a5d9-27693f185d61 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:37.340417 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5519c61-5d95-42df-a5d9-27693f185d61 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:37.341970 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 608/1221] 10.222.0.73 () {54 vars in 921 bytes} [Wed Jul 27 18:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:37.352144 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c27605-c3cf-4da8-9b8a-9e13578ce218 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:37.353097 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c27605-c3cf-4da8-9b8a-9e13578ce218 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:37.353544 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c27605-c3cf-4da8-9b8a-9e13578ce218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:37.386400 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-59c27605-c3cf-4da8-9b8a-9e13578ce218 None None] MFA Rules not processed for user `de6300c387da4594bca473cd708b79f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:37.390747 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-59c27605-c3cf-4da8-9b8a-9e13578ce218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:37.402982 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 614/1222] 10.222.0.73 () {58 vars in 1018 bytes} [Wed Jul 27 18:04:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:37.414599 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5519c61-5d95-42df-a5d9-27693f185d61 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:37.429709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5519c61-5d95-42df-a5d9-27693f185d61 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:37.436479 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e738d-060e-4327-92d9-a614da2dc539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:37.437302 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e738d-060e-4327-92d9-a614da2dc539 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:37.437760 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e738d-060e-4327-92d9-a614da2dc539 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:37.438202 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e738d-060e-4327-92d9-a614da2dc539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:37.450346 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e738d-060e-4327-92d9-a614da2dc539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:37.452267 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e738d-060e-4327-92d9-a614da2dc539 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:37.475559 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 609/1223] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:04:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:04:47.369220 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=9 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:47.459589 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=6 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:49.608865 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7613d3b-8344-4b82-a444-cf22897a98f4 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:49.609371 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7613d3b-8344-4b82-a444-cf22897a98f4 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:49.609482 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7613d3b-8344-4b82-a444-cf22897a98f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:49.627517 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-a7613d3b-8344-4b82-a444-cf22897a98f4 None None] MFA Rules not processed for user `b17b75a81fdc48e99ea19a1c65007e53`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:49.628694 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-a7613d3b-8344-4b82-a444-cf22897a98f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:49.635852 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 615/1224] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:04:49 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:50.056586 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da0326-2363-41a4-ba21-798221ddcfed None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.057585 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da0326-2363-41a4-ba21-798221ddcfed None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.057709 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da0326-2363-41a4-ba21-798221ddcfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.077169 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-21da0326-2363-41a4-ba21-798221ddcfed None None] MFA Rules not processed for user `54abb42639f1401bb6433e2d4642d741`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:50.078348 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-21da0326-2363-41a4-ba21-798221ddcfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:50.084631 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 610/1225] 10.222.0.73 () {58 vars in 1009 bytes} [Wed Jul 27 18:04:50 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:04:50.095517 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7613d3b-8344-4b82-a444-cf22897a98f4 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:50.104936 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7613d3b-8344-4b82-a444-cf22897a98f4 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:50.108554 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbde0f-e0d6-497f-bc57-dd80ac4dbead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:50.109171 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbde0f-e0d6-497f-bc57-dd80ac4dbead service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.109453 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbde0f-e0d6-497f-bc57-dd80ac4dbead service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.109730 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbde0f-e0d6-497f-bc57-dd80ac4dbead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.116937 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbde0f-e0d6-497f-bc57-dd80ac4dbead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:50.118353 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbde0f-e0d6-497f-bc57-dd80ac4dbead service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:50.126621 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 616/1226] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:04:50 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:05:00.071920 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=3 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:00.123282 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=9 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:14.077007 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5d98d-7226-47ad-822f-ef09b63d5c70 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:14.077455 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5d98d-7226-47ad-822f-ef09b63d5c70 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:14.077564 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5d98d-7226-47ad-822f-ef09b63d5c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:14.096638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-fda5d98d-7226-47ad-822f-ef09b63d5c70 None None] MFA Rules not processed for user `b17b75a81fdc48e99ea19a1c65007e53`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:14.097829 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-fda5d98d-7226-47ad-822f-ef09b63d5c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:14.105716 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 611/1227] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:05:14 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:05:24.091489 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=3 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:27.379712 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193b559-4304-4011-b184-9d6584d8c110 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:27.380162 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193b559-4304-4011-b184-9d6584d8c110 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:27.380278 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193b559-4304-4011-b184-9d6584d8c110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:27.399614 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-a193b559-4304-4011-b184-9d6584d8c110 None None] MFA Rules not processed for user `b17b75a81fdc48e99ea19a1c65007e53`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:27.400823 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-a193b559-4304-4011-b184-9d6584d8c110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:27.407856 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 617/1228] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:05:27 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:05:37.394849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=3 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:25.899234 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4ea7-f12e-4412-9b21-6867727363ed None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:25.899747 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4ea7-f12e-4412-9b21-6867727363ed None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:25.899916 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4ea7-f12e-4412-9b21-6867727363ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:25.918859 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-e95a4ea7-f12e-4412-9b21-6867727363ed None None] MFA Rules not processed for user `b17b75a81fdc48e99ea19a1c65007e53`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:25.920063 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-e95a4ea7-f12e-4412-9b21-6867727363ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:25.927201 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 612/1229] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:06:25 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:06:35.913510 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=3 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:37.686066 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193b559-4304-4011-b184-9d6584d8c110 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:37.705562 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193b559-4304-4011-b184-9d6584d8c110 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:37.710157 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a169940-9ed8-42a1-93ec-5d22b7472c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:37.711065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169940-9ed8-42a1-93ec-5d22b7472c85 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:37.711506 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169940-9ed8-42a1-93ec-5d22b7472c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:37.711840 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169940-9ed8-42a1-93ec-5d22b7472c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:37.721941 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a169940-9ed8-42a1-93ec-5d22b7472c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:37.723488 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a169940-9ed8-42a1-93ec-5d22b7472c85 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:37.733553 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 618/1230] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:06:37 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:06:47.729493 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=10 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:07:03.109689 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a4ea7-f12e-4412-9b21-6867727363ed None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:07:03.133548 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a4ea7-f12e-4412-9b21-6867727363ed None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:07:03.138993 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d707a-0e66-46e6-bc4a-6a8f5748af38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5144a9d861f8482a8f31abc1315fe818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:07:03.139609 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d707a-0e66-46e6-bc4a-6a8f5748af38 service placement] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:07:03.139883 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d707a-0e66-46e6-bc4a-6a8f5748af38 service placement] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:07:03.140206 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d707a-0e66-46e6-bc4a-6a8f5748af38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:07:03.149769 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d707a-0e66-46e6-bc4a-6a8f5748af38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:07:03.151501 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d707a-0e66-46e6-bc4a-6a8f5748af38 service placement] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:07:03.163108 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 613/1231] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:07:03 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:07:13.157775 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=10 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:20.491452 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ab201-6a05-4e4b-8ad3-3404a199c795 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:20.491951 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ab201-6a05-4e4b-8ad3-3404a199c795 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:20.492047 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ab201-6a05-4e4b-8ad3-3404a199c795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:20.510764 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-c44ab201-6a05-4e4b-8ad3-3404a199c795 None None] MFA Rules not processed for user `a8a906fcdba344d59bdbfa0ac9f5a4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:20.511956 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-c44ab201-6a05-4e4b-8ad3-3404a199c795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:20.519578 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 619/1232] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:08:20 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:08:30.506061 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=3 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:48.198494 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02ec4-53ac-4f9b-855c-64f7bf7a065e None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:48.199148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02ec4-53ac-4f9b-855c-64f7bf7a065e None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:48.199148 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02ec4-53ac-4f9b-855c-64f7bf7a065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:48.219449 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-5fa02ec4-53ac-4f9b-855c-64f7bf7a065e None None] MFA Rules not processed for user `b17b75a81fdc48e99ea19a1c65007e53`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:48.220675 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-5fa02ec4-53ac-4f9b-855c-64f7bf7a065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:48.229940 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 614/1233] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:08:48 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:08:51.073136 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ab201-6a05-4e4b-8ad3-3404a199c795 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:51.150703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ab201-6a05-4e4b-8ad3-3404a199c795 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:51.155486 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824ca52-8239-475e-9f64-9d68029ae21e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856e3f650ab34f15828f1adb320d03ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:51.156117 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824ca52-8239-475e-9f64-9d68029ae21e service cinder] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:51.156386 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824ca52-8239-475e-9f64-9d68029ae21e service cinder] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:51.156661 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824ca52-8239-475e-9f64-9d68029ae21e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:51.167240 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824ca52-8239-475e-9f64-9d68029ae21e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:51.168707 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824ca52-8239-475e-9f64-9d68029ae21e service cinder] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:51.178942 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 620/1234] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:08:51 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:08:58.214421 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=3 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:09:01.174399 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=30 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:09:12.643863 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa02ec4-53ac-4f9b-855c-64f7bf7a065e None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:09:12.666014 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa02ec4-53ac-4f9b-855c-64f7bf7a065e None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:09:12.671211 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b318a21-d038-4e4e-a07d-ddb9e4b66200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:09:12.671813 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b318a21-d038-4e4e-a07d-ddb9e4b66200 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:09:12.672096 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b318a21-d038-4e4e-a07d-ddb9e4b66200 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:09:12.672375 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b318a21-d038-4e4e-a07d-ddb9e4b66200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:09:12.680444 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b318a21-d038-4e4e-a07d-ddb9e4b66200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:09:12.682024 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b318a21-d038-4e4e-a07d-ddb9e4b66200 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:09:12.690682 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 615/1235] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:09:12 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:09:12.843172 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824ca52-8239-475e-9f64-9d68029ae21e service cinder] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:09:12.853210 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824ca52-8239-475e-9f64-9d68029ae21e service cinder] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:09:12.853547 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b318a21-d038-4e4e-a07d-ddb9e4b66200 service nova] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:09:12.856571 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ba8c9-e41a-421c-86e6-734824af4f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:09:12.857183 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba8c9-e41a-421c-86e6-734824af4f62 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:09:12.857461 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba8c9-e41a-421c-86e6-734824af4f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:09:12.857735 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba8c9-e41a-421c-86e6-734824af4f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:09:12.862495 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b318a21-d038-4e4e-a07d-ddb9e4b66200 service nova] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:09:12.866411 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ac966-dd5e-4762-9acf-3e6c0d84c7e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:09:12.867074 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ac966-dd5e-4762-9acf-3e6c0d84c7e5 service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:09:12.867358 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ac966-dd5e-4762-9acf-3e6c0d84c7e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:09:12.867529 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ba8c9-e41a-421c-86e6-734824af4f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:09:12.867636 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ac966-dd5e-4762-9acf-3e6c0d84c7e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:09:12.868933 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ba8c9-e41a-421c-86e6-734824af4f62 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:09:12.874861 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ac966-dd5e-4762-9acf-3e6c0d84c7e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:09:12.876281 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ac966-dd5e-4762-9acf-3e6c0d84c7e5 service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:09:12.879080 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 621/1236] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:09:12 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:09:12.885371 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 616/1237] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:09:12 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:09:14.178635 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ba8c9-e41a-421c-86e6-734824af4f62 service neutron] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:09:14.186841 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ba8c9-e41a-421c-86e6-734824af4f62 service neutron] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:09:14.190668 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a152-ffaa-41a6-abd9-fec62a3d1025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:09:14.191292 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a152-ffaa-41a6-abd9-fec62a3d1025 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:09:14.191575 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a152-ffaa-41a6-abd9-fec62a3d1025 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:09:14.191855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a152-ffaa-41a6-abd9-fec62a3d1025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:09:14.201435 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993a152-ffaa-41a6-abd9-fec62a3d1025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:09:14.202902 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993a152-ffaa-41a6-abd9-fec62a3d1025 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:09:14.213540 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 622/1238] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:09:14 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:09:22.881896 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=16 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:09:24.209833 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=12 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:09:57.807861 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ac966-dd5e-4762-9acf-3e6c0d84c7e5 service neutron] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:09:57.835727 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ac966-dd5e-4762-9acf-3e6c0d84c7e5 service neutron] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:09:57.852678 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac10e0-4003-4534-9154-f72a58a02d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:09:57.853723 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac10e0-4003-4534-9154-f72a58a02d38 service nova] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:09:57.854200 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac10e0-4003-4534-9154-f72a58a02d38 service nova] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:09:57.854858 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac10e0-4003-4534-9154-f72a58a02d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:09:57.872519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac10e0-4003-4534-9154-f72a58a02d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:09:57.875995 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac10e0-4003-4534-9154-f72a58a02d38 service nova] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:09:57.909247 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 617/1239] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:09:57 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:10:04.110592 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a152-ffaa-41a6-abd9-fec62a3d1025 service neutron] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:10:04.121400 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a152-ffaa-41a6-abd9-fec62a3d1025 service neutron] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:10:04.127763 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0e3b-96db-494e-8999-7411ebed712b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:10:04.128537 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0e3b-96db-494e-8999-7411ebed712b service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:04.128849 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0e3b-96db-494e-8999-7411ebed712b service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:04.129212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0e3b-96db-494e-8999-7411ebed712b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:04.138787 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b0e3b-96db-494e-8999-7411ebed712b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:10:04.140521 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b0e3b-96db-494e-8999-7411ebed712b service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:10:04.151971 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 623/1240] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:10:04 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:10:05.604515 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac10e0-4003-4534-9154-f72a58a02d38 service nova] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:10:05.614793 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac10e0-4003-4534-9154-f72a58a02d38 service nova] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:10:05.618446 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897c84f-06d9-4a6a-accd-51d3ecc2c1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:10:05.619089 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897c84f-06d9-4a6a-accd-51d3ecc2c1cc service neutron] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:05.619375 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897c84f-06d9-4a6a-accd-51d3ecc2c1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:05.619654 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897c84f-06d9-4a6a-accd-51d3ecc2c1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:05.682315 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897c84f-06d9-4a6a-accd-51d3ecc2c1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:10:05.683985 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897c84f-06d9-4a6a-accd-51d3ecc2c1cc service neutron] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:10:05.702805 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 618/1241] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:10:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:10:09.163259 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e6e7d-2421-4e94-bc64-372da0c1584d None None] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:09.163751 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e6e7d-2421-4e94-bc64-372da0c1584d None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:09.163890 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e6e7d-2421-4e94-bc64-372da0c1584d None None] PATH_INFO: `/` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:09.165253 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 624/1242] 10.222.0.73 () {54 vars in 921 bytes} [Wed Jul 27 18:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:10:09.182369 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf6579-ef9b-4f65-9640-76ee120e08cd None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:09.182885 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf6579-ef9b-4f65-9640-76ee120e08cd None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:09.183328 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf6579-ef9b-4f65-9640-76ee120e08cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:09.418554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-02cf6579-ef9b-4f65-9640-76ee120e08cd None None] MFA Rules not processed for user `5144a9d861f8482a8f31abc1315fe818`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:10:09.418554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-02cf6579-ef9b-4f65-9640-76ee120e08cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:10:09.423820 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 619/1243] 10.222.0.73 () {58 vars in 1018 bytes} [Wed Jul 27 18:10:09 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:10:09.435055 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e6e7d-2421-4e94-bc64-372da0c1584d None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:10:09.450156 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e6e7d-2421-4e94-bc64-372da0c1584d None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:10:09.455887 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5a03c-c302-457a-b52b-4eea8d466f0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5144a9d861f8482a8f31abc1315fe818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:10:09.456696 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5a03c-c302-457a-b52b-4eea8d466f0f service placement] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:09.457177 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5a03c-c302-457a-b52b-4eea8d466f0f service placement] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:09.457597 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5a03c-c302-457a-b52b-4eea8d466f0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:09.469640 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5a03c-c302-457a-b52b-4eea8d466f0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:10:09.471488 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5a03c-c302-457a-b52b-4eea8d466f0f service placement] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:10:09.487848 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 625/1244] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:10:09 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:10:12.784695 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f890e-3894-4d6b-ae16-67b261a7a772 None None] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:12.785633 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f890e-3894-4d6b-ae16-67b261a7a772 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:12.785898 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f890e-3894-4d6b-ae16-67b261a7a772 None None] PATH_INFO: `/` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:12.787279 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 620/1245] 10.222.0.73 () {54 vars in 921 bytes} [Wed Jul 27 18:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:10:12.817560 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cf49b-b831-43d6-bc31-12ce89b9d116 None None] REQUEST_METHOD: `POST` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:12.818021 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cf49b-b831-43d6-bc31-12ce89b9d116 None None] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:12.818242 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cf49b-b831-43d6-bc31-12ce89b9d116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:12.839150 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.auth.core [None req-f16cf49b-b831-43d6-bc31-12ce89b9d116 None None] MFA Rules not processed for user `5144a9d861f8482a8f31abc1315fe818`. Rule list: `[]` (Enabled: `True`). {{(pid=87221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:10:12.840381 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-f16cf49b-b831-43d6-bc31-12ce89b9d116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:10:12.853819 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 626/1246] 10.222.0.73 () {58 vars in 1018 bytes} [Wed Jul 27 18:10:12 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:10:12.854865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f890e-3894-4d6b-ae16-67b261a7a772 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:10:12.869426 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f890e-3894-4d6b-ae16-67b261a7a772 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:10:12.872994 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cf49b-b831-43d6-bc31-12ce89b9d116 None None] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:10:12.876383 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:10:12.877182 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:12.877506 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:12.877854 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] PATH_INFO: `/v3/users/a8a906fcdba344d59bdbfa0ac9f5a4e2` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:12.879735 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a906fcdba344d59bdbfa0ac9f5a4e2)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:10:12.881940 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:10:12.889294 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cf49b-b831-43d6-bc31-12ce89b9d116 None None] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:10:12.894789 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb943c36-fe65-4c85-9138-5ad9aa1b2ba3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5144a9d861f8482a8f31abc1315fe818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:10:12.895427 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb943c36-fe65-4c85-9138-5ad9aa1b2ba3 service placement] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:12.895932 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb943c36-fe65-4c85-9138-5ad9aa1b2ba3 service placement] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:12.896212 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb943c36-fe65-4c85-9138-5ad9aa1b2ba3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:12.905034 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb943c36-fe65-4c85-9138-5ad9aa1b2ba3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:10:12.906714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb943c36-fe65-4c85-9138-5ad9aa1b2ba3 service placement] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:10:12.917492 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 627/1247] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:10:12 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:10:12.943740 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a906fcdba344d59bdbfa0ac9f5a4e2'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:12.957210 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a906fcdba344d59bdbfa0ac9f5a4e2'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:12.957977 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a906fcdba344d59bdbfa0ac9f5a4e2'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:12.958635 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a906fcdba344d59bdbfa0ac9f5a4e2'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:12.970318 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a906fcdba344d59bdbfa0ac9f5a4e2'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:12.982522 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 621/1248] 10.222.0.73 () {58 vars in 1224 bytes} [Wed Jul 27 18:10:12 2022] DELETE /identity/v3/users/a8a906fcdba344d59bdbfa0ac9f5a4e2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:10:13.189192 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb943c36-fe65-4c85-9138-5ad9aa1b2ba3 service placement] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:10:13.206123 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb943c36-fe65-4c85-9138-5ad9aa1b2ba3 service placement] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:10:13.282924 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:10:13.283600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:13.283886 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:13.284168 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] PATH_INFO: `/v3/projects/0306beae7ba74e629b9b8f9dde062a30` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:13.285600 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0306beae7ba74e629b9b8f9dde062a30)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:10:13.287618 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:10:13.341286 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0306beae7ba74e629b9b8f9dde062a30', 'request_id': 'req-106fb418-ae9a-4b35-a202-43930f2f6cc5'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.347528 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0306beae7ba74e629b9b8f9dde062a30', 'request_id': 'req-106fb418-ae9a-4b35-a202-43930f2f6cc5'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.356355 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0306beae7ba74e629b9b8f9dde062a30', 'request_id': 'req-106fb418-ae9a-4b35-a202-43930f2f6cc5'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.370293 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] The token cache is being invalidate because project 0306beae7ba74e629b9b8f9dde062a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:10:13.370609 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.371275 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.372831 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 628/1249] 10.222.0.73 () {58 vars in 1233 bytes} [Wed Jul 27 18:10:13 2022] DELETE /identity/v3/projects/0306beae7ba74e629b9b8f9dde062a30 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:10:13.377267 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:10:13.378824 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:10:13.395308 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:10:13.401999 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c788fba-b4a9-45ed-be7a-eb8aaf7e60cf admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:10:13.471359 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5960b-1147-4dd1-8056-ff964591c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:10:13.472223 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5960b-1147-4dd1-8056-ff964591c6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:13.472511 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5960b-1147-4dd1-8056-ff964591c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:13.472789 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5960b-1147-4dd1-8056-ff964591c6df admin admin] PATH_INFO: `/v3/users/8a0e75df2d694e70ba143dccd4fa0cbf` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:13.474648 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5960b-1147-4dd1-8056-ff964591c6df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0e75df2d694e70ba143dccd4fa0cbf)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:10:13.476354 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5960b-1147-4dd1-8056-ff964591c6df admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:10:13.528306 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-8da5960b-1147-4dd1-8056-ff964591c6df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0e75df2d694e70ba143dccd4fa0cbf'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.542094 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-8da5960b-1147-4dd1-8056-ff964591c6df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0e75df2d694e70ba143dccd4fa0cbf'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.542851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-8da5960b-1147-4dd1-8056-ff964591c6df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0e75df2d694e70ba143dccd4fa0cbf'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.543495 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-8da5960b-1147-4dd1-8056-ff964591c6df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0e75df2d694e70ba143dccd4fa0cbf'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.554399 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-8da5960b-1147-4dd1-8056-ff964591c6df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0e75df2d694e70ba143dccd4fa0cbf'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.567393 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 622/1250] 10.222.0.73 () {58 vars in 1224 bytes} [Wed Jul 27 18:10:13 2022] DELETE /identity/v3/users/8a0e75df2d694e70ba143dccd4fa0cbf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:10:13.747749 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:10:13.749179 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:10:13.762396 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb418-ae9a-4b35-a202-43930f2f6cc5 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:10:13.814302 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:10:13.831438 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:10:13.832184 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:13.832471 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:13.832754 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] PATH_INFO: `/v3/projects/ef1d8e4561f2430cb4cdb1bdf53070ff` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:13.833948 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1d8e4561f2430cb4cdb1bdf53070ff)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:10:13.835898 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:10:13.884785 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1d8e4561f2430cb4cdb1bdf53070ff', 'request_id': 'req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.891855 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1d8e4561f2430cb4cdb1bdf53070ff', 'request_id': 'req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.900122 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1d8e4561f2430cb4cdb1bdf53070ff', 'request_id': 'req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.911744 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] The token cache is being invalidate because project ef1d8e4561f2430cb4cdb1bdf53070ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:10:13.912028 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.912685 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:10:13.914203 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 629/1251] 10.222.0.73 () {58 vars in 1233 bytes} [Wed Jul 27 18:10:13 2022] DELETE /identity/v3/projects/ef1d8e4561f2430cb4cdb1bdf53070ff => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:10:23.563977 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:10:23.908359 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:10:42.652338 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32244d70-2585-47d6-98ac-5b8375c114f3 None None] REQUEST_METHOD: `POST` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:42.652836 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32244d70-2585-47d6-98ac-5b8375c114f3 None None] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:42.652933 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32244d70-2585-47d6-98ac-5b8375c114f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:42.672144 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.auth.core [None req-32244d70-2585-47d6-98ac-5b8375c114f3 None None] MFA Rules not processed for user `b17b75a81fdc48e99ea19a1c65007e53`. Rule list: `[]` (Enabled: `True`). {{(pid=87220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:10:42.673343 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-32244d70-2585-47d6-98ac-5b8375c114f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:10:42.728213 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 623/1252] 10.222.0.73 () {58 vars in 958 bytes} [Wed Jul 27 18:10:42 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:10:43.056771 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:10:43.058276 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:10:43.115102 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb89fe-4d2b-4c6b-a8e7-41ba68da1512 admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:10:43.118619 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393dbbd-60c1-4fd3-ae8f-69ded57a18e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:10:43.119246 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393dbbd-60c1-4fd3-ae8f-69ded57a18e8 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:43.119528 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393dbbd-60c1-4fd3-ae8f-69ded57a18e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:43.119808 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393dbbd-60c1-4fd3-ae8f-69ded57a18e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:43.121538 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-4393dbbd-60c1-4fd3-ae8f-69ded57a18e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:10:43.131867 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393dbbd-60c1-4fd3-ae8f-69ded57a18e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:10:43.133351 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393dbbd-60c1-4fd3-ae8f-69ded57a18e8 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:10:43.141254 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 630/1253] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:10:43 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:10:43.601045 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32244d70-2585-47d6-98ac-5b8375c114f3 None None] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:10:43.603387 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-32244d70-2585-47d6-98ac-5b8375c114f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:10:43.689180 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32244d70-2585-47d6-98ac-5b8375c114f3 None None] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:10:43.695314 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07fdc4-efd6-4139-9215-c3b776493783 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5144a9d861f8482a8f31abc1315fe818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:10:43.695960 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07fdc4-efd6-4139-9215-c3b776493783 service placement] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:43.696246 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07fdc4-efd6-4139-9215-c3b776493783 service placement] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:43.696525 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07fdc4-efd6-4139-9215-c3b776493783 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:43.698403 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-cd07fdc4-efd6-4139-9215-c3b776493783 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:10:43.711083 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07fdc4-efd6-4139-9215-c3b776493783 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:10:43.712680 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07fdc4-efd6-4139-9215-c3b776493783 service placement] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:10:43.723170 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 624/1254] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:10:43 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:10:52.781360 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393dbbd-60c1-4fd3-ae8f-69ded57a18e8 service neutron] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:10:52.783133 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-4393dbbd-60c1-4fd3-ae8f-69ded57a18e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:10:52.863655 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393dbbd-60c1-4fd3-ae8f-69ded57a18e8 service neutron] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:10:52.869719 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5fb4-47cc-45d5-b6f5-d0bfd3612a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de6300c387da4594bca473cd708b79f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:10:52.870353 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5fb4-47cc-45d5-b6f5-d0bfd3612a5d service nova] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:10:52.870737 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5fb4-47cc-45d5-b6f5-d0bfd3612a5d service nova] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:10:52.870935 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5fb4-47cc-45d5-b6f5-d0bfd3612a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:10:52.872789 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-484e5fb4-47cc-45d5-b6f5-d0bfd3612a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:10:52.885065 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e5fb4-47cc-45d5-b6f5-d0bfd3612a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:10:52.886703 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e5fb4-47cc-45d5-b6f5-d0bfd3612a5d service nova] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:10:52.897553 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 631/1255] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:10:52 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:10:53.718760 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=57 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:11:02.892869 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=58 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:12:05.916483 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07fdc4-efd6-4139-9215-c3b776493783 service placement] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:12:05.918013 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-cd07fdc4-efd6-4139-9215-c3b776493783 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:12:05.984543 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07fdc4-efd6-4139-9215-c3b776493783 service placement] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:12:05.989557 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb8886-ce36-41a9-8df9-6827c80f1113 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5144a9d861f8482a8f31abc1315fe818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:12:05.990173 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb8886-ce36-41a9-8df9-6827c80f1113 service placement] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:12:05.990459 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb8886-ce36-41a9-8df9-6827c80f1113 service placement] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:12:05.990768 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb8886-ce36-41a9-8df9-6827c80f1113 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:12:05.992554 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-eeeb8886-ce36-41a9-8df9-6827c80f1113 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:12:06.004649 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb8886-ce36-41a9-8df9-6827c80f1113 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:12:06.006229 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb8886-ce36-41a9-8df9-6827c80f1113 service placement] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:12:06.016656 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 625/1256] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:12:05 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:12:16.012660 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=28 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:13:20.255969 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5fb4-47cc-45d5-b6f5-d0bfd3612a5d service nova] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:13:20.276343 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5fb4-47cc-45d5-b6f5-d0bfd3612a5d service nova] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:13:20.286282 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559b14e-27b8-4da6-91a5-a162f0762d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54abb42639f1401bb6433e2d4642d741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:13:20.286948 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559b14e-27b8-4da6-91a5-a162f0762d50 service neutron] REQUEST_METHOD: `GET` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:13:20.287230 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559b14e-27b8-4da6-91a5-a162f0762d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:13:20.287505 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559b14e-27b8-4da6-91a5-a162f0762d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:13:20.289291 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-b559b14e-27b8-4da6-91a5-a162f0762d50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:13:20.376083 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559b14e-27b8-4da6-91a5-a162f0762d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:13:20.377524 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559b14e-27b8-4da6-91a5-a162f0762d50 service neutron] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:13:20.387228 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 632/1257] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:13:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:13:27.051519 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb8886-ce36-41a9-8df9-6827c80f1113 service placement] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:13:27.053015 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-eeeb8886-ce36-41a9-8df9-6827c80f1113 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:13:27.074865 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb8886-ce36-41a9-8df9-6827c80f1113 service placement] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:13:27.081149 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:13:27.081851 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:13:27.082139 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:13:27.082535 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] PATH_INFO: `/v3/users/b17b75a81fdc48e99ea19a1c65007e53` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:13:27.084163 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17b75a81fdc48e99ea19a1c65007e53)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:13:27.086771 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:13:27.145131 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17b75a81fdc48e99ea19a1c65007e53'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.159317 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17b75a81fdc48e99ea19a1c65007e53'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.160020 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17b75a81fdc48e99ea19a1c65007e53'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.160638 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17b75a81fdc48e99ea19a1c65007e53'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.172249 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17b75a81fdc48e99ea19a1c65007e53'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.186373 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 626/1258] 10.222.0.73 () {58 vars in 1224 bytes} [Wed Jul 27 18:13:27 2022] DELETE /identity/v3/users/b17b75a81fdc48e99ea19a1c65007e53 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:13:27.387136 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559b14e-27b8-4da6-91a5-a162f0762d50 service neutron] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:13:27.398134 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559b14e-27b8-4da6-91a5-a162f0762d50 service neutron] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:13:27.463123 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:13:27.463779 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:13:27.464062 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:13:27.464347 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] PATH_INFO: `/v3/projects/5d2bc566a1c9440f81b52c0f7ad8840e` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:13:27.465564 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d2bc566a1c9440f81b52c0f7ad8840e)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:13:27.467615 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:13:27.534926 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d2bc566a1c9440f81b52c0f7ad8840e', 'request_id': 'req-567aa0e2-1f0e-4e2d-b700-3da957384efa'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.541714 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d2bc566a1c9440f81b52c0f7ad8840e', 'request_id': 'req-567aa0e2-1f0e-4e2d-b700-3da957384efa'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.552817 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d2bc566a1c9440f81b52c0f7ad8840e', 'request_id': 'req-567aa0e2-1f0e-4e2d-b700-3da957384efa'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.555806 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:13:27.581876 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] The token cache is being invalidate because project 5d2bc566a1c9440f81b52c0f7ad8840e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:13:27.582585 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.583286 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.585028 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 633/1259] 10.222.0.73 () {58 vars in 1233 bytes} [Wed Jul 27 18:13:27 2022] DELETE /identity/v3/projects/5d2bc566a1c9440f81b52c0f7ad8840e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:13:27.589164 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:13:27.590643 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:13:27.604982 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e129e7c-6819-4df5-be68-ca0f15418546 admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:13:27.673769 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:13:27.674350 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:13:27.674672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:13:27.674957 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] PATH_INFO: `/v3/users/ec3147f25972479b973bc666b9b6b975` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:13:27.676175 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3147f25972479b973bc666b9b6b975)` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:13:27.678185 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:13:27.736833 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3147f25972479b973bc666b9b6b975'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.751845 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3147f25972479b973bc666b9b6b975'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.752672 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3147f25972479b973bc666b9b6b975'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.753304 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3147f25972479b973bc666b9b6b975'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.762649 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.notifications [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3147f25972479b973bc666b9b6b975'} {{(pid=87220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:27.765627 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:13:27.782683 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 627/1260] 10.222.0.73 () {58 vars in 1224 bytes} [Wed Jul 27 18:13:27 2022] DELETE /identity/v3/users/ec3147f25972479b973bc666b9b6b975 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:13:28.000590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] Authenticating user token {{(pid=87221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:13:28.000590 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.fernet_utils [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:13:28.016351 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aa0e2-1f0e-4e2d-b700-3da957384efa admin admin] Validating token access rules against request {{(pid=87221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:13:28.095305 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c437a71edd54d15a20aca35e290b469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62c6a98aca8a4b2da0a78051d92a86b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:13:28.095305 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:13:28.095305 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:13:28.095305 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] PATH_INFO: `/v3/projects/c54340e9ad4b4267b250ca6b5f6b590b` {{(pid=87221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:13:28.095762 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54340e9ad4b4267b250ca6b5f6b590b)` {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:13:28.096067 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] RBAC: Authorization granted {{(pid=87221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:13:28.149382 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54340e9ad4b4267b250ca6b5f6b590b', 'request_id': 'req-6287da50-77eb-4002-a2b7-52655f36f407'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:28.159326 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54340e9ad4b4267b250ca6b5f6b590b', 'request_id': 'req-6287da50-77eb-4002-a2b7-52655f36f407'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:28.168498 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54340e9ad4b4267b250ca6b5f6b590b', 'request_id': 'req-6287da50-77eb-4002-a2b7-52655f36f407'} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:28.183281 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] The token cache is being invalidate because project c54340e9ad4b4267b250ca6b5f6b590b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:13:28.183658 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:28.184519 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG keystone.notifications [None req-6287da50-77eb-4002-a2b7-52655f36f407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:13:28.186750 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: [pid: 87221|app: 0|req: 634/1261] 10.222.0.73 () {58 vars in 1233 bytes} [Wed Jul 27 18:13:27 2022] DELETE /identity/v3/projects/c54340e9ad4b4267b250ca6b5f6b590b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:13:37.781567 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=4 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:13:38.178989 dv-osbrick-849019-4-ceph devstack@keystone.service[87221]: DEBUG dbcounter [-] [87221] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:11.078323 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] Authenticating user token {{(pid=87220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:11.079798 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:11.161714 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf723c2-f229-4653-88b4-d4508ad503c4 admin admin] Validating token access rules against request {{(pid=87220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:11.222405 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3c165-071e-4db0-8738-fb0b78436623 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5144a9d861f8482a8f31abc1315fe818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf65bac3a154c95b119204e594db593', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:11.223054 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3c165-071e-4db0-8738-fb0b78436623 service placement] REQUEST_METHOD: `GET` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:11.223327 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3c165-071e-4db0-8738-fb0b78436623 service placement] SCRIPT_NAME: `/identity` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:11.223597 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3c165-071e-4db0-8738-fb0b78436623 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:11.225329 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.fernet_utils [None req-e0c3c165-071e-4db0-8738-fb0b78436623 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:11.236727 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3c165-071e-4db0-8738-fb0b78436623 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:11.238303 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3c165-071e-4db0-8738-fb0b78436623 service placement] RBAC: Authorization granted {{(pid=87220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:11.247824 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: [pid: 87220|app: 0|req: 628/1262] 10.222.0.73 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:11 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:21.243826 dv-osbrick-849019-4-ceph devstack@keystone.service[87220]: DEBUG dbcounter [-] [87220] Writing DB stats keystone:SELECT=62 {{(pid=87220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}